-- Logs begin at Tue 2022-05-10 15:57:26 UTC, end at Tue 2022-05-10 16:57:26 UTC. -- May 10 16:36:06.278557 dv-cinder-841302-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 16:36:06.288005 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 16:36:06.289961 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 16:36:06 2022] *** May 10 16:36:06.289961 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 16:36:06.289961 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 16:36:06.289961 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: nodename: dv-cinder-841302-1-iscsi May 10 16:36:06.289961 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: machine: x86_64 May 10 16:36:06.289961 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: clock source: unix May 10 16:36:06.289961 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: pcre jit disabled May 10 16:36:06.289961 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: detected number of CPU cores: 4 May 10 16:36:06.289961 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: current working directory: / May 10 16:36:06.289961 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: detected binary path: /usr/bin/uwsgi-core May 10 16:36:06.290708 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: your processes number limit is 47680 May 10 16:36:06.290708 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: your memory page size is 4096 bytes May 10 16:36:06.290708 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: detected max file descriptor number: 2048 May 10 16:36:06.290708 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: lock engine: pthread robust mutexes May 10 16:36:06.290708 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: thunder lock: enabled May 10 16:36:06.290708 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 16:36:06.290708 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 16:36:06.334639 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: Python main interpreter initialized at 0x55adcab849c0 May 10 16:36:06.334639 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: python threads support enabled May 10 16:36:06.334639 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: your server socket listen backlog is limited to 100 connections May 10 16:36:06.334639 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: your mercy for graceful operations on workers is 90 seconds May 10 16:36:06.334951 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: mapped 403077 bytes (393 KB) for 2 cores May 10 16:36:06.335071 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: *** Operational MODE: preforking *** May 10 16:36:06.335308 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: *** uWSGI is running in multiple interpreter mode *** May 10 16:36:06.335308 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: spawned uWSGI master process (pid: 114578) May 10 16:36:06.335477 dv-cinder-841302-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 16:36:06.336417 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: spawned uWSGI worker 1 (pid: 114579, cores: 1) May 10 16:36:06.336417 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: spawned uWSGI worker 2 (pid: 114580, cores: 1) May 10 16:36:06.336610 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 16:36:07.538049 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 16:36:07.547230 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 16:36:08.265974 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:36:08.265974 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: from cryptography.utils import int_from_bytes May 10 16:36:08.266293 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:36:08.266293 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: from cryptography.utils import int_from_bytes May 10 16:36:08.269840 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:36:08.269840 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: from cryptography.utils import int_from_bytes May 10 16:36:08.270169 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:36:08.270169 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: from cryptography.utils import int_from_bytes May 10 16:36:10.884681 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 16:36:10.885174 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 16:36:10.885364 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 16:36:10.885735 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 16:36:10.885996 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 16:36:10.886389 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.886726 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.887114 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.887214 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 16:36:10.887666 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.887797 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 16:36:10.887926 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.888038 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 16:36:10.888121 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.888350 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 16:36:10.888462 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.889469 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 16:36:10.890620 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.890733 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.890834 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.890834 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.891015 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.891096 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.891193 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.891279 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841302-1-iscsi {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.891370 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.891456 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.891549 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.891633 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.891712 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.891800 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.891887 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.891965 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.892050 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.892128 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.892211 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.892211 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.892366 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.892442 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.892524 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.892608 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841302-1-iscsi {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.893121 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.893232 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.893232 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.893360 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.893436 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.893508 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.893593 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.893666 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.893889 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.894048 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.894204 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.894423 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.894589 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.894727 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.894870 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.895046 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.895212 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.895377 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.895525 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.895661 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.895835 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.895988 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.896185 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.896335 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841302-1-iscsi {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.897085 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.897233 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.897382 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.897519 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.897660 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.897796 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.897948 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.898121 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.898280 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.898424 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.898569 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.898741 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.898930 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841302-1-iscsi {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.899121 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.899281 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.899419 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.899569 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.899706 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.899862 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.900031 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.900265 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.900410 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.900559 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.900711 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.900856 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.900999 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.901175 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.901334 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.901478 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.901622 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.901791 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.901956 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.902101 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.902252 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.902422 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.902567 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.902740 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.902892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.903054 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.903363 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.903513 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.903690 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.903843 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.904019 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.904165 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.904348 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.904504 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.904657 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.904809 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.904953 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.905108 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.905245 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.905394 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.905531 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.905667 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.905813 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.905961 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.906105 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.906241 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.906384 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.906527 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.906671 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.906808 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.906947 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.907134 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.907279 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.907514 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.907835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.908143 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.908452 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.908757 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.909062 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.909366 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.909673 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.909978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.910283 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.910600 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.910913 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.911258 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.911555 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.911731 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.911914 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.912072 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.912286 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.912473 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.912630 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.912774 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.912970 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.913125 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.913322 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.913475 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.913655 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.913822 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.913960 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.914101 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.914273 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.914419 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.914594 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.914739 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.914900 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.915108 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.915261 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.915406 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.915543 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.915701 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.915839 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.915982 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.916128 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.916277 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.916426 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.916595 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.916740 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.916917 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.917078 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.917225 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.917363 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.917542 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.917702 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.917853 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.917989 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.918125 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.918260 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.918426 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.918577 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.918727 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.918864 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.919064 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.919227 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.919366 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.919508 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.919690 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.919842 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.919980 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.920124 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.920537 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.920691 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.920840 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.920977 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.921137 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.921282 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.921427 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.921571 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.921716 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.921862 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.922035 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.922188 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.922351 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.922506 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.922644 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.922786 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.922929 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.923129 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.923277 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.923501 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.923649 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.923786 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.923938 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.924086 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.924223 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.924368 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.924511 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.924648 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.924783 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.924925 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.925062 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.925205 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.925342 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.925477 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.925626 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.925777 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.925928 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.926077 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.926220 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.926368 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.926514 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.926651 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.926787 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.926941 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.927104 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.927251 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.927413 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.927577 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.927761 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.927915 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.928053 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.928189 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.928360 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.928506 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.928650 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.928796 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.928955 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.929100 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.929261 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.929421 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.929584 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.929722 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.929858 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.929994 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.930136 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.930303 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.930457 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.930596 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.930739 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.930911 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.931106 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.931246 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.931397 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.931551 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.931697 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.931836 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.931979 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.932124 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.932270 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.932407 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.932584 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.932730 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.932926 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.933084 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.933243 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.933388 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.933584 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.933729 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.933903 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.934060 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.934224 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.934368 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:36:10.934537 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.934688 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.934851 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.935033 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.935214 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.935360 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.935529 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.935674 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.935842 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.935998 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.936144 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.936281 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.936458 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.936609 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.936778 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.936929 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.937106 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.937263 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.937408 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.937554 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.937729 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.937883 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.938075 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.938227 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.938382 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.938526 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.938703 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.938855 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.939054 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.939206 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.939373 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.939533 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.939680 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.939816 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.940009 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.940159 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.940332 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.940486 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.940634 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.940776 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.940962 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.941109 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.941282 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.941427 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.941587 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.941725 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.941893 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.942046 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.942205 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.942359 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.942527 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.942673 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.942860 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.943040 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.943186 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.943820 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.944028 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.944185 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.944352 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.944504 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.944665 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.944888 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.945028 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.945172 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.945311 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.945447 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.945584 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.945733 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.945878 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.946032 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.946198 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.946344 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.946516 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.946662 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.946830 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.947039 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.947185 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.947323 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.947484 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.947625 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.947762 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.947898 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.948051 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.948231 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.948383 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.948527 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.948671 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.948808 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.948943 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.949078 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.949223 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.949367 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.949511 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.949648 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.949830 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.949997 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.950172 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.950322 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.950467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.950611 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.950748 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.950898 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.951068 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.951208 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.951361 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.951513 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.951674 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.951828 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.951976 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.952114 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.952277 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.952422 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.952589 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.952744 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.952903 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.953048 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.953209 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.953353 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.953533 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.953680 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.953893 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.954054 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.954192 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.954328 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.954473 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.954618 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.954756 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.954893 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.955071 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.955210 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.955358 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.955502 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.955669 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.955825 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.955969 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.956115 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.956265 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.956403 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.956571 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.956717 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.956892 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.957056 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.957194 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.957331 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.957502 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.957654 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.957835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.957994 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.958165 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.958310 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.958454 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.958592 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.958781 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.959577 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.959739 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.959879 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.960016 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.960153 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.960291 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.960450 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.960589 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.960725 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.960900 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.961046 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.961197 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.961346 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.961491 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.961629 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.961796 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.961942 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.962097 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.962246 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.962383 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.962520 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.962683 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.962829 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.963020 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.963166 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.963304 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.963441 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.963611 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.963756 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.963906 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.964044 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.964218 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.964364 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.964508 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.964655 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.964816 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.964969 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.965158 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.965312 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.965450 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.965596 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.965797 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.965943 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.966136 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.966294 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.966432 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.966576 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.966740 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.966893 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.967071 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.967211 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.967400 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.967562 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.967715 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.967859 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.968013 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.968164 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.968336 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.968482 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.968625 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.968768 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.968923 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.969068 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.969220 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.969376 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.969527 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.969670 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.969813 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.969956 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.970133 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.970303 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.970450 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.970599 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.970743 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.970886 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.971103 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.971252 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.971396 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.971548 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.971694 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.971838 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.972025 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.972187 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.972331 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.972476 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.972654 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.972814 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.972960 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.973104 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.973269 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.973421 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.973575 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.973796 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.973942 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.974086 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.974239 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.974383 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.974547 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.974707 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.974852 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.975033 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.975186 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.975338 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.975482 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.975639 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.975784 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.975928 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.976070 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.976223 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.976386 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.976532 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.976676 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.976818 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.976961 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.977147 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.977311 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.977463 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.977606 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.977756 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.977908 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.978064 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.978227 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.978379 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.978524 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.978701 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.978860 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.979042 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.979206 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.979352 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.979496 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.979662 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.979823 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.980001 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.980161 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.980317 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.980472 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.980617 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.980788 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.980943 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.981087 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.981230 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.981392 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.981582 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.981730 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.981882 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.982035 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.982190 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.982342 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.982486 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.982630 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.982786 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.982932 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.983138 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.983285 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.983429 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.983572 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.983731 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.983876 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.984020 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.984186 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.984332 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.984488 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.984633 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.984776 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.984986 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.985149 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.985304 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.985458 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.985604 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.985748 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.985890 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.986034 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.986192 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.986346 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.986498 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.986643 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.986786 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.986929 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.987098 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.987256 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.987401 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.987547 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.987697 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.987860 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.988017 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.988182 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.988329 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.988472 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.988616 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.988765 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.988918 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.989074 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.989225 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.989370 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.989513 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.989656 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.989808 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.989959 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.990140 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.990293 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.990437 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.990581 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.990733 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.990885 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.991076 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.991234 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.991379 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.991532 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.991690 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.991835 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.991995 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.992140 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.992282 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.992436 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.992587 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.992732 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.992875 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.993017 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.993165 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.993284 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.993372 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.993541 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.993634 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.993861 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.994111 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.994214 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.994443 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.994533 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.994758 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.994846 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.995102 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.995205 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.995422 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.995517 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.995732 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.995828 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.996054 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.996151 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.996378 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.996463 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.996715 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.996949 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.997045 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.997289 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.997386 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.997610 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.997697 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.997917 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.998006 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.998229 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.998325 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.998533 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.998620 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.998838 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.998925 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.999167 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.999258 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.999477 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.999571 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.999783 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:10.999885 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.000087 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.000182 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.000390 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.000477 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.000697 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.000785 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.001010 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.001110 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.001318 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.001481 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.001636 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.001782 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.001941 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.002098 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.002249 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.002394 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.002537 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.002681 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.002837 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.003020 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.003175 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.003320 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.003463 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.003606 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.003762 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.003917 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.004078 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.004231 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.004383 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.004526 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.004684 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.004829 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.004973 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.005116 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.005261 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.005417 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.005562 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.005728 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.006401 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.006547 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.006690 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.006843 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.007016 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.007170 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.007328 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.007473 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.007617 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.007769 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.007913 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.008056 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.008208 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.008362 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.008506 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.008658 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.008811 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.008955 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.009098 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.009254 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.009408 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.009552 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.009695 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.009838 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.009988 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.010133 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.010295 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.010441 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.010591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.010736 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.010878 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.011070 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.011230 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.011377 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.011527 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.011671 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.011825 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.011969 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.012121 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.012282 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.012428 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.012570 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.012714 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.012871 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.013022 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.013172 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.013323 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.013469 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.013612 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.013763 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.013908 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.014061 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.014204 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.014347 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.014491 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.014643 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.014787 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.014938 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.015116 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.015263 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.015407 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.015564 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.015710 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.015853 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.016013 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.016166 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.016319 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.016464 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.016608 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.016751 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.016893 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.017043 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.017197 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.017341 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.017484 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.017628 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.017771 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.017924 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.018075 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.018220 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.018362 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.018505 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.018648 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.018791 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.018948 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.019116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.019260 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.019404 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.019546 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.019707 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.019866 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.020010 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.020153 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.020304 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.020449 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.020604 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.020761 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.020905 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.021048 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.021198 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.021385 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.022078 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.022235 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.022397 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.022550 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.022694 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.022848 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.023030 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.023190 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.023335 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.023478 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.023630 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.023783 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.023936 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.024080 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.024234 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.024378 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.024521 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.024676 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.024820 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.024964 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.025116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.025260 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.025410 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.025561 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.025705 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.025847 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.025996 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.026149 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.026300 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.026486 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.026633 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.026776 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.026919 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.027100 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.027255 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.027442 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.027588 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.027738 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.027883 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.028033 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.028197 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.028349 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.028494 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.028645 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.028789 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.028931 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.029083 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.029236 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.029379 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.029522 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.029664 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.029814 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.029967 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.030128 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.030274 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.030425 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.030569 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.030712 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.030864 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.031034 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.031186 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.031331 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.031479 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.031634 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.031796 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.031941 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.032094 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.032239 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.032381 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.032532 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.032682 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.032837 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.032982 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.033132 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.033286 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.033508 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.033693 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.033853 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.034009 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.034159 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.034301 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.034454 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.034599 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.034749 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.034893 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.035093 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.035252 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.035398 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.035542 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.035685 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.035828 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.035982 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.036133 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.036277 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.036421 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.036573 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.036717 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.036868 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.037043 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.037202 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.037355 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.037500 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.037644 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.037794 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.037957 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.038101 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.038297 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.038447 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.038592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.038749 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.038902 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.039064 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.039154 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.039234 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.039443 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.039546 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.039839 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.039927 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.040134 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.040232 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.040446 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.040545 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.040754 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.040842 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.041059 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.041155 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.041368 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.041465 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.041686 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.041780 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.041989 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.042074 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.042293 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.042382 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.042598 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.042714 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.042919 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.043054 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.043246 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.043373 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.043572 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.043745 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.043987 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.044138 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.044292 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.044444 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.044588 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.044732 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.044914 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.045065 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.045219 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.045621 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.045766 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.045910 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.046075 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.046250 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.046404 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.046548 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.046691 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.046834 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.047014 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.047178 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.047381 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.047539 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.047685 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.047841 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.047987 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.048154 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.048334 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.048484 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.048637 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.048807 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.048962 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.049109 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.049347 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.049522 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.049672 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.049818 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.049969 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.050116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.050313 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.050473 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.050618 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.050763 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.050905 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.051090 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.051250 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.051395 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.051538 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.051689 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.051833 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.051978 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.052129 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.052308 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.052459 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.052604 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.052789 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.052949 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.053103 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.053258 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.053412 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.053565 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.053717 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.053876 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.054031 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.054187 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.054332 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.054484 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.054629 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.054781 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.054926 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.055096 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.055191 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.055402 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.055492 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.055709 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.055818 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.056025 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.056121 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.056333 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.056432 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.056653 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.056744 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.056964 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.057051 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.057282 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.057368 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.057595 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.057682 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.057899 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.057993 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.058216 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.058310 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.058525 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.058619 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.058831 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.058918 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.059163 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.059268 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.059466 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.059554 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.059790 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.059877 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.060102 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.060201 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.060423 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.060518 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.060748 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.060835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.061073 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.061172 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.061383 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.061468 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.061711 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.061798 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.062029 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.062117 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.062341 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.062452 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.062656 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.062756 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.062986 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.063077 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.063291 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.063377 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.063595 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.063682 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.063915 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.064024 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.064218 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.064306 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.064523 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.064617 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.064827 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.064916 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.065134 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.065221 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.065437 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.065570 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.065743 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.065904 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.066051 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.066205 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.066358 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.066517 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.066663 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.066808 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.066953 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.067122 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.067266 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.067423 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.067569 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.067713 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.067857 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.068002 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.068164 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.068835 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.069011 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.069164 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.069320 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.069465 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.069619 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.069764 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.069938 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.070091 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.070260 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.070421 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.070588 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.070739 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.070883 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.071091 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.071242 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.071386 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.071542 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.071687 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.071838 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.071982 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.072127 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.072279 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.072425 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.072591 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.072737 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.072881 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.073035 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.073256 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.073404 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.073548 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.073700 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.073845 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.073996 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.074158 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.074311 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.074456 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.074619 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.074764 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.074915 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.075093 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.075250 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.075395 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.075539 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.075683 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.075853 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.076018 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.076165 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.076310 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.076464 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.076616 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.076769 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.076914 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.077082 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.077233 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.077388 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.077532 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.077688 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.077834 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.078015 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.078168 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.078385 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.078554 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.078717 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.078863 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.079090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.079243 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.079389 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.079546 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.079693 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.079837 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.079981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.080125 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.080268 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.080494 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.080641 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.080794 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.080939 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.081088 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.081241 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.081393 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.081539 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.081683 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.081827 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.081971 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.082122 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.082283 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.082429 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.082574 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.082728 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.082896 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.083087 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.083242 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.083341 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.083564 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.083654 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.083908 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.084546 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.084760 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.084861 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.085124 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.085212 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.085443 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.085540 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.085757 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.085862 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.086080 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.086193 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.086402 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.086489 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.086713 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.086803 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.087049 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.087155 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.087368 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.087456 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.087685 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.087888 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.088007 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.088211 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.088325 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.088548 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.088635 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.088878 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.088973 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.089207 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.089295 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.089527 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.089614 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.089848 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.089952 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.090176 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.090263 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.090487 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.090575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.090796 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.090892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.091135 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.091223 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.091449 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.091672 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.091772 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.091998 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.092087 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.092338 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.092425 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.092655 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.092748 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.092977 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.093078 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.093286 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.093374 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.093605 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.093816 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.093937 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.094162 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.094250 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.094478 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.094564 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.094815 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.095014 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.095182 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.095330 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.095492 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.095709 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.095885 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.096036 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.096188 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.096342 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.096487 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.096663 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.096822 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.096969 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.097124 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.097269 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.097421 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.097575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.097721 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.097865 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.098008 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.098152 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.098298 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.098459 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.098606 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.098757 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.098911 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.099118 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.099274 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.099429 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.099673 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.099885 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.100036 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.100180 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.100338 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.100496 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.100654 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.100799 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.100944 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.101095 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.101274 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.101420 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.101566 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.101711 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.101856 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.101999 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.102153 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.102306 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.102452 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.102597 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.102741 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.102885 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.103074 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.103224 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.103368 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.103510 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.103669 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.103827 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.103973 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.104116 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.104260 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.104404 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.104548 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.104701 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.104847 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.105001 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.105146 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.105296 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.105442 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.105595 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.105741 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.105894 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.106046 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.106197 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.106342 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.106498 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.106644 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.106788 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.106945 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.107124 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.107272 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.107425 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.107577 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.107722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.107866 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.108011 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.108162 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.108308 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.108459 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.108604 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.108758 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.108913 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.109066 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.109211 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.109355 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.109498 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.109642 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.109819 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.110047 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.110196 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.110339 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.110489 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.110646 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.110810 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.110981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.111148 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.111294 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.111446 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.111591 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.111744 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.111948 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.112102 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.112277 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.112428 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.112580 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.112734 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.112889 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.113034 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.113178 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.113321 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.113466 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.113628 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.113774 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.113917 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.114069 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.114214 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.114372 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.114519 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.114708 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.114862 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.115039 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.115714 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.115877 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.116023 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.116178 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.116324 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.116493 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.116647 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.116805 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.116950 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.117094 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.117250 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.117394 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.117550 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.117696 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.117840 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.117983 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.118127 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.118314 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.118483 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.118629 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.118773 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.118927 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.119136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.119319 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.119480 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.119626 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.119769 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.119953 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.120106 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.120260 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.120412 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.120558 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.120708 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.120878 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.121031 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.121193 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.121338 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.121484 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.121628 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.121779 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.121924 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.122102 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.122255 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.122432 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.122591 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.122738 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.122889 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.123074 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.123180 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.123419 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.123523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.123727 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.123836 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.124033 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.124129 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.124340 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.124436 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.124656 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.124754 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.124974 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.125063 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.125284 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.125383 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.125591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.125680 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.125895 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.125983 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.126207 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.126302 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.126516 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.126625 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.126818 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.126905 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.127147 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.127271 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.127453 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.127608 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.127763 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.127924 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.128066 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.128237 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.128369 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.128557 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.128675 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.128875 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.128970 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.129200 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.129288 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.129515 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.129602 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.129827 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.129914 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.130139 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.130228 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.130440 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.130526 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.130762 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.131429 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.131605 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.131695 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.131909 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.131997 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.132219 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.132305 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.132536 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.132624 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.132847 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.132942 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.133157 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.133259 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.133467 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.133555 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.133777 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.133865 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.134133 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.134237 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.134399 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.134488 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.134717 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.134804 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.135061 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.135165 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.135376 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.135473 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.135686 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.135774 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.135996 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.136093 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.136305 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.136402 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.136615 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.136721 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.136925 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.137015 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.137235 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.137332 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.137547 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.137636 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.137870 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.137966 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.138205 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.138304 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.138511 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.138599 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.138837 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.138927 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.139183 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.139275 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.139502 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.139666 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.139818 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.139904 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.140155 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.140250 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.140474 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.140571 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.140793 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.140889 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.141112 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.141200 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.141425 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.141521 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.141740 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.141826 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.142048 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.142133 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.142364 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.142460 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.142681 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.142767 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.143011 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.143101 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.143347 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.143438 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.143670 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.143760 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.143994 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.144079 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.144316 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.144404 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.144634 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.144722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.144974 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.145062 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.145293 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.145383 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.145612 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.145701 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.145926 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.146021 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.146233 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.146320 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.146515 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 16:36:11.146621 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.146879 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.147226 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.147563 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.147900 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.148238 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.148571 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.148924 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.149242 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.149594 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.149931 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.150254 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.150572 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.150900 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:36:11.151174 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114579) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 16:36:11.169272 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG oslo_db.sqlalchemy.engines [None req-d7961f1b-f5ab-4899-8eb2-a55f51060f3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:36:11.173786 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_db.sqlalchemy.engines [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:36:11.231678 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.context [None req-d7961f1b-f5ab-4899-8eb2-a55f51060f3e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4d8f7176-9260-4d0a-bdf3-ff932fd2323c(cell1) {{(pid=114580) load_cells /opt/stack/nova/nova/context.py:464}} May 10 16:36:11.235979 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG oslo_concurrency.lockutils [None req-d7961f1b-f5ab-4899-8eb2-a55f51060f3e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:36:11.236361 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.context [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4d8f7176-9260-4d0a-bdf3-ff932fd2323c(cell1) {{(pid=114579) load_cells /opt/stack/nova/nova/context.py:464}} May 10 16:36:11.237542 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG oslo_concurrency.lockutils [None req-d7961f1b-f5ab-4899-8eb2-a55f51060f3e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:36:11.238338 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG oslo_concurrency.lockutils [None req-d7961f1b-f5ab-4899-8eb2-a55f51060f3e None None] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:36:11.240797 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG oslo_concurrency.lockutils [None req-d7961f1b-f5ab-4899-8eb2-a55f51060f3e None None] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114580) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:36:11.241191 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:36:11.242774 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:36:11.243600 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:36:11.245531 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:36:11.252059 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG oslo_db.sqlalchemy.engines [None req-d7961f1b-f5ab-4899-8eb2-a55f51060f3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:36:11.255216 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG oslo_db.sqlalchemy.engines [None req-d7961f1b-f5ab-4899-8eb2-a55f51060f3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:36:11.259957 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_db.sqlalchemy.engines [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:36:11.262448 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_db.sqlalchemy.engines [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:36:11.413782 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG oslo_db.sqlalchemy.engines [None req-d7961f1b-f5ab-4899-8eb2-a55f51060f3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:36:11.419568 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_db.sqlalchemy.engines [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114579) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:36:11.753430 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: WARNING keystonemiddleware.auth_token [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 16:36:11.753623 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: WARNING keystonemiddleware.auth_token [None req-d7961f1b-f5ab-4899-8eb2-a55f51060f3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 16:36:11.760786 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: WARNING keystonemiddleware.auth_token [None req-d7961f1b-f5ab-4899-8eb2-a55f51060f3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 16:36:11.761642 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: WARNING keystonemiddleware.auth_token [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 16:36:12.103176 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: WARNING keystonemiddleware.auth_token [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 16:36:12.110051 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: WARNING keystonemiddleware.auth_token [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 16:36:12.110317 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: WARNING keystonemiddleware.auth_token [None req-d7961f1b-f5ab-4899-8eb2-a55f51060f3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 16:36:12.115186 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55adcab849c0 pid: 114579 (default app) May 10 16:36:12.116398 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: WARNING keystonemiddleware.auth_token [None req-d7961f1b-f5ab-4899-8eb2-a55f51060f3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 16:36:12.117255 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:36:12.118426 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001737 May 10 16:36:12.119136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Tue May 10 16:36:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:36:12.122545 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55adcab849c0 pid: 114580 (default app) May 10 16:37:29.797965 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:37:29.798988 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 10 16:37:29.799389 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 16:37:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:37:30.225610 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-e6f78b78-c2d5-44bd-b3ce-92d6bde1fe52 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:37:30.255606 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-e6f78b78-c2d5-44bd-b3ce-92d6bde1fe52 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.448944 May 10 16:37:30.266990 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1291 bytes} [Tue May 10 16:37:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:37:32.529317 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:37:32.530325 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-ca3f0d49-1865-480e-85ad-d6ef4409eee5 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 10 16:37:32.530726 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 16:37:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:37:32.591223 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-e0c4b56b-9c10-43a7-9bd1-d18ea6ec4b9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "swap": 0}} {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:32.609864 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:37:32.609864 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: warnings.warn(msg) May 10 16:37:32.639015 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-e0c4b56b-9c10-43a7-9bd1-d18ea6ec4b9c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.101542 May 10 16:37:32.639893 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 16:37:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:37:32.862580 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-f9fe264e-7044-46e9-9e48-d15ba9eb33ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:32.865676 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:37:32.865676 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: warnings.warn(msg) May 10 16:37:32.918000 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-f9fe264e-7044-46e9-9e48-d15ba9eb33ac admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.270378 May 10 16:37:32.919241 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1335 bytes} [Tue May 10 16:37:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:37:35.198150 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-e0c4b56b-9c10-43a7-9bd1-d18ea6ec4b9c admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:37:35.199218 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-e0c4b56b-9c10-43a7-9bd1-d18ea6ec4b9c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 10 16:37:35.199621 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 16:37:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:37:35.303001 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-2038d22d-e5f3-46d4-adba-9bf1eed79d08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:35.321379 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:37:35.321379 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: warnings.warn(msg) May 10 16:37:35.339288 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-2038d22d-e5f3-46d4-adba-9bf1eed79d08 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133740 May 10 16:37:35.339845 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 16:37:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:37:35.351223 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-631ec8b5-0c54-4cf3-be35-33a73b647ecb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:35.352689 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:37:35.352689 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: warnings.warn(msg) May 10 16:37:35.386206 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-631ec8b5-0c54-4cf3-be35-33a73b647ecb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038540 May 10 16:37:35.386984 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1335 bytes} [Tue May 10 16:37:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:37:37.693219 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-2038d22d-e5f3-46d4-adba-9bf1eed79d08 admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:37:37.694230 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-2038d22d-e5f3-46d4-adba-9bf1eed79d08 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 May 10 16:37:37.694635 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 16:37:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:37:37.754106 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-1ca4a6bb-7498-4a37-8ae9-f851d6c1466d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G", "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024, "disk": 10, "rxtx_factor": 1.0}} {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:37.775657 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-1ca4a6bb-7498-4a37-8ae9-f851d6c1466d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075113 May 10 16:37:37.776970 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 16:37:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:37:37.788134 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-dc79e928-0b2c-4d25-bfcd-0a9f13c64618 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:37.810781 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-dc79e928-0b2c-4d25-bfcd-0a9f13c64618 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026231 May 10 16:37:37.811463 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1335 bytes} [Tue May 10 16:37:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:37:40.133755 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-1ca4a6bb-7498-4a37-8ae9-f851d6c1466d admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:37:40.134777 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-1ca4a6bb-7498-4a37-8ae9-f851d6c1466d admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 May 10 16:37:40.135210 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 16:37:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:37:40.194681 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-4cc3f6b2-4a81-489e-9d87-fbb516da5a5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "swap": 0, "disk": 10, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:40.213330 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-4cc3f6b2-4a81-489e-9d87-fbb516da5a5c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072250 May 10 16:37:40.214158 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 16:37:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:37:40.228704 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-d7589adf-861c-4ec7-b3f0-ce8b005905c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:40.252345 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-d7589adf-861c-4ec7-b3f0-ce8b005905c7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027352 May 10 16:37:40.253167 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1335 bytes} [Tue May 10 16:37:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:37:42.536335 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-4cc3f6b2-4a81-489e-9d87-fbb516da5a5c admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:37:42.537339 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-4cc3f6b2-4a81-489e-9d87-fbb516da5a5c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 10 16:37:42.537926 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 16:37:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:37:42.599881 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-77cf2557-950d-4998-9184-59aef2ee06fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "swap": 0, "disk": 20, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:42.617483 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-77cf2557-950d-4998-9184-59aef2ee06fd admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073946 May 10 16:37:42.619092 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 16:37:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:37:42.630211 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-d42b05b6-83f3-4321-9863-772e8689bd27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:42.651948 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-d42b05b6-83f3-4321-9863-772e8689bd27 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026025 May 10 16:37:42.652713 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1335 bytes} [Tue May 10 16:37:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:37:44.908320 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-77cf2557-950d-4998-9184-59aef2ee06fd admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:37:44.909333 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-77cf2557-950d-4998-9184-59aef2ee06fd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 May 10 16:37:44.909751 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 16:37:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:37:44.969487 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-174d7993-691a-4862-9310-a4cffca33b5e admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:37:44.993361 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-174d7993-691a-4862-9310-a4cffca33b5e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077496 May 10 16:37:44.994073 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1291 bytes} [Tue May 10 16:37:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:37:47.277869 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-77cf2557-950d-4998-9184-59aef2ee06fd admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:37:47.279207 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-77cf2557-950d-4998-9184-59aef2ee06fd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001799 May 10 16:37:47.279746 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 16:37:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:37:47.347862 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-c9692e2b-8384-4b91-a449-d4c1cd8e67b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.tiny", "ram": 512, "id": "1"}} {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:47.368920 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-c9692e2b-8384-4b91-a449-d4c1cd8e67b6 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081891 May 10 16:37:47.369520 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 16:37:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:37:47.382872 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-8b6590a5-69b2-400a-9f11-23eaa4836416 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:47.406912 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-8b6590a5-69b2-400a-9f11-23eaa4836416 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027774 May 10 16:37:47.407567 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1332 bytes} [Tue May 10 16:37:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:37:49.763415 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-c9692e2b-8384-4b91-a449-d4c1cd8e67b6 admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:37:49.764725 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-c9692e2b-8384-4b91-a449-d4c1cd8e67b6 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001911 May 10 16:37:49.765282 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 16:37:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:37:49.827220 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-545d052d-abe6-4772-8f28-ab342d254cfd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "swap": 0, "id": "2", "os-flavor-access:is_public": true, "ram": 2048, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:49.844864 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-545d052d-abe6-4772-8f28-ab342d254cfd admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073438 May 10 16:37:49.845447 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 16:37:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:37:49.857921 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-e6e3c953-589e-437d-9415-82e8c90ea747 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:49.881522 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-e6e3c953-589e-437d-9415-82e8c90ea747 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027348 May 10 16:37:49.882170 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1332 bytes} [Tue May 10 16:37:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:37:52.198488 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-545d052d-abe6-4772-8f28-ab342d254cfd admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:37:52.199547 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-545d052d-abe6-4772-8f28-ab342d254cfd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 10 16:37:52.199953 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 16:37:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:37:52.258764 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-c41b0127-5403-4684-861e-0b695746abe7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "rxtx_factor": 1.0, "disk": 40, "vcpus": 2}} {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:52.277507 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-c41b0127-5403-4684-861e-0b695746abe7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071809 May 10 16:37:52.278072 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 16:37:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:37:52.289722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-a07289e3-3a59-492c-8409-917646b4ffbe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:52.311164 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-a07289e3-3a59-492c-8409-917646b4ffbe admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025009 May 10 16:37:52.311736 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1332 bytes} [Tue May 10 16:37:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:37:54.568150 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-c41b0127-5403-4684-861e-0b695746abe7 admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:37:54.569267 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-c41b0127-5403-4684-861e-0b695746abe7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001665 May 10 16:37:54.569738 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 16:37:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:37:54.630119 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-b1bfc037-a70e-4aca-9e34-f2931f2a9b06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "ram": 8192, "vcpus": 4, "name": "m1.large", "disk": 80}} {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:54.647104 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-b1bfc037-a70e-4aca-9e34-f2931f2a9b06 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071420 May 10 16:37:54.647648 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 16:37:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:37:54.659270 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-7ecd344c-fb8f-4fe4-b67a-44e2d4ec28d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:54.682399 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-7ecd344c-fb8f-4fe4-b67a-44e2d4ec28d8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026726 May 10 16:37:54.682999 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1332 bytes} [Tue May 10 16:37:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:37:56.974642 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-b1bfc037-a70e-4aca-9e34-f2931f2a9b06 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:37:56.975748 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-b1bfc037-a70e-4aca-9e34-f2931f2a9b06 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 May 10 16:37:56.976136 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 16:37:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:37:57.040565 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-3a48ef1a-412b-435c-8f99-9b559bf481e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8}} {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:57.058737 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-3a48ef1a-412b-435c-8f99-9b559bf481e4 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.076914 May 10 16:37:57.059722 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1282 bytes} [Tue May 10 16:37:56 2022] POST /compute/v2.1/flavors => generated 408 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:37:57.071429 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-8d8b7875-6ff7-42f6-bd82-94788e499218 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:37:57.096788 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-8d8b7875-6ff7-42f6-bd82-94788e499218 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028901 May 10 16:37:57.097705 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1332 bytes} [Tue May 10 16:37:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:38:21.546664 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-3a48ef1a-412b-435c-8f99-9b559bf481e4 admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:21.547726 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-3a48ef1a-412b-435c-8f99-9b559bf481e4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001726 May 10 16:38:21.548129 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 16:38:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:38:21.603857 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-4e6699c9-71d9-47ad-9df6-7581a5ef91b4 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:21.622117 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-4e6699c9-71d9-47ad-9df6-7581a5ef91b4 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067481 May 10 16:38:21.622647 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1291 bytes} [Tue May 10 16:38:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:38:22.620075 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-3a48ef1a-412b-435c-8f99-9b559bf481e4 admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:22.621077 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-3a48ef1a-412b-435c-8f99-9b559bf481e4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 10 16:38:22.621475 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 16:38:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:38:22.822285 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-42549af3-c5c2-47e0-9b61-478688eab237 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:22.827727 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.wsgi [None req-42549af3-c5c2-47e0-9b61-478688eab237 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-42549af3-c5c2-47e0-9b61-478688eab237 admin admin] Request method failure captured: May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Accept: application/json May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Accept-Encoding: gzip, deflate May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Connection: keep-alive May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Content-Length: 0 May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Host: 10.222.0.57 May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Openstack-Api-Version: compute 2.90 May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Openstack-System-Scope: None May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: User-Agent: python-novaclient May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Auth-Token: gAAAAABiepT-cQL0OzeAcpdAxjLanZOiu1JrBGsgIU7WIS_7K9QLDMcq18rTqpB3ASGBo8aMq9RSthNQ-WTLBiLLvsiy6w0PCPUEPwTcvI6Kb2DLJF9EGc8Kcx4AdDeWubFnCS76xwQr8XYKeaMNOobGWytpW4rfiHwn9OYuUq_gBbXP5XYWKTs May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Domain-Id: None May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Domain-Name: None May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Identity-Status: Confirmed May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Is-Admin-Project: True May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Openstack-Nova-Api-Version: 2.90 May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Project-Domain-Id: default May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Project-Domain-Name: Default May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Project-Id: 4f2ab0bb70f249b18504d9e6616306cf May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Project-Name: admin May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Role: admin,member,reader May 10 16:38:22.830981 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Roles: admin,member,reader May 10 16:38:22.832763 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:38:22.832763 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Tenant: admin May 10 16:38:22.832763 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Tenant-Id: 4f2ab0bb70f249b18504d9e6616306cf May 10 16:38:22.832763 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Tenant-Name: admin May 10 16:38:22.832763 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-User: admin May 10 16:38:22.832763 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-User-Domain-Id: default May 10 16:38:22.832763 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-User-Domain-Name: Default May 10 16:38:22.832763 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-User-Id: 0464ce0cc2c244588f440cfed98f23ff May 10 16:38:22.832763 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-User-Name: admin May 10 16:38:22.832763 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: method: > May 10 16:38:22.832763 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: exception: Flavor 42 could not be found. May 10 16:38:22.832763 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: action_args: {'id': '42'} May 10 16:38:22.832763 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:38:22.832763 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:38:22.836090 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:38:22.837592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:38:22.837592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:38:22.837592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:38:22.837592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:38:22.837592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 16:38:22.837592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 16:38:22.837592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 16:38:22.837592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi May 10 16:38:22.837592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:38:22.837592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi May 10 16:38:22.837592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:38:22.837592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:38:22.837592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:38:22.837592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:38:22.837592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:38:22.837592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 16:38:22.837592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi May 10 16:38:22.837592 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-42549af3-c5c2-47e0-9b61-478688eab237 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:38:22.838894 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-42549af3-c5c2-47e0-9b61-478688eab237 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059885 May 10 16:38:22.838894 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Tue May 10 16:38:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 16:38:22.842125 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-621d7508-f785-4a6a-b856-fe3117297dab admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:22.862786 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-621d7508-f785-4a6a-b856-fe3117297dab admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024237 May 10 16:38:22.863896 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Tue May 10 16:38:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:38:22.873233 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-38f3f47d-b732-48d9-b432-0829c02f8690 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:22.893936 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-38f3f47d-b732-48d9-b432-0829c02f8690 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024202 May 10 16:38:22.894473 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Tue May 10 16:38:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:38:22.904007 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-80e6a490-e74f-4ca2-958e-2d12570216ab admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:22.909400 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.wsgi [None req-80e6a490-e74f-4ca2-958e-2d12570216ab admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-80e6a490-e74f-4ca2-958e-2d12570216ab admin admin] Request method failure captured: May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Accept: application/json May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Accept-Encoding: gzip, deflate May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Connection: keep-alive May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Content-Length: 0 May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Host: 10.222.0.57 May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Openstack-Api-Version: compute 2.90 May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Openstack-System-Scope: None May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: User-Agent: python-novaclient May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Auth-Token: gAAAAABiepT-cQL0OzeAcpdAxjLanZOiu1JrBGsgIU7WIS_7K9QLDMcq18rTqpB3ASGBo8aMq9RSthNQ-WTLBiLLvsiy6w0PCPUEPwTcvI6Kb2DLJF9EGc8Kcx4AdDeWubFnCS76xwQr8XYKeaMNOobGWytpW4rfiHwn9OYuUq_gBbXP5XYWKTs May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Domain-Id: None May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Domain-Name: None May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Identity-Status: Confirmed May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Is-Admin-Project: True May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Openstack-Nova-Api-Version: 2.90 May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Project-Domain-Id: default May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Project-Domain-Name: Default May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Project-Id: 4f2ab0bb70f249b18504d9e6616306cf May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Project-Name: admin May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Role: admin,member,reader May 10 16:38:22.913116 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Roles: admin,member,reader May 10 16:38:22.914608 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:38:22.914608 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Tenant: admin May 10 16:38:22.914608 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Tenant-Id: 4f2ab0bb70f249b18504d9e6616306cf May 10 16:38:22.914608 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Tenant-Name: admin May 10 16:38:22.914608 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-User: admin May 10 16:38:22.914608 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-User-Domain-Id: default May 10 16:38:22.914608 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-User-Domain-Name: Default May 10 16:38:22.914608 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-User-Id: 0464ce0cc2c244588f440cfed98f23ff May 10 16:38:22.914608 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-User-Name: admin May 10 16:38:22.914608 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: method: > May 10 16:38:22.914608 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: exception: Flavor 42 could not be found. May 10 16:38:22.914608 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: action_args: {'id': '42'} May 10 16:38:22.914608 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:38:22.914608 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:38:22.915523 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:38:22.916892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:38:22.916892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:38:22.916892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:38:22.916892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:38:22.916892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 16:38:22.916892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 16:38:22.916892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 16:38:22.916892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi May 10 16:38:22.916892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:38:22.916892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi May 10 16:38:22.916892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:38:22.916892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:38:22.916892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:38:22.916892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:38:22.916892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:38:22.916892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 16:38:22.916892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi May 10 16:38:22.916892 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-80e6a490-e74f-4ca2-958e-2d12570216ab admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:38:22.918110 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-80e6a490-e74f-4ca2-958e-2d12570216ab admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014386 May 10 16:38:22.918110 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Tue May 10 16:38:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 10 16:38:23.790832 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-38f3f47d-b732-48d9-b432-0829c02f8690 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:23.791866 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-38f3f47d-b732-48d9-b432-0829c02f8690 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 10 16:38:23.792256 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 16:38:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:38:23.983799 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-72348214-efab-4873-91e3-7e55e3349e74 admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:23.989555 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.wsgi [None req-72348214-efab-4873-91e3-7e55e3349e74 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-72348214-efab-4873-91e3-7e55e3349e74 admin admin] Request method failure captured: May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Accept: application/json May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Accept-Encoding: gzip, deflate May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Connection: keep-alive May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Content-Length: 0 May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Host: 10.222.0.57 May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Openstack-Api-Version: compute 2.90 May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Openstack-System-Scope: None May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: User-Agent: python-novaclient May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Auth-Token: gAAAAABiepT_cgnHM39nPvI4_WmL6F3eD2zoHNbn48Yr6rxLvG2ZHHhv37yLNKvNb1jlzLASkRZ0rxqxLlSR0YpDC088_RBA7me07ayCuyF0-tAhTne3bo3g2TdKnS8DUIlBpsXiIgqrKecce9BkJkdzI38EYwwq_d-Bc9qU_seW6PukUPtBxQo May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Domain-Id: None May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Domain-Name: None May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Identity-Status: Confirmed May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Is-Admin-Project: True May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Openstack-Nova-Api-Version: 2.90 May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Project-Domain-Id: default May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Project-Domain-Name: Default May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Project-Id: 4f2ab0bb70f249b18504d9e6616306cf May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Project-Name: admin May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Role: admin,member,reader May 10 16:38:23.991089 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Roles: admin,member,reader May 10 16:38:23.992622 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:38:23.992622 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Tenant: admin May 10 16:38:23.992622 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Tenant-Id: 4f2ab0bb70f249b18504d9e6616306cf May 10 16:38:23.992622 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Tenant-Name: admin May 10 16:38:23.992622 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-User: admin May 10 16:38:23.992622 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-User-Domain-Id: default May 10 16:38:23.992622 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-User-Domain-Name: Default May 10 16:38:23.992622 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-User-Id: 0464ce0cc2c244588f440cfed98f23ff May 10 16:38:23.992622 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-User-Name: admin May 10 16:38:23.992622 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: method: > May 10 16:38:23.992622 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: exception: Flavor 84 could not be found. May 10 16:38:23.992622 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: action_args: {'id': '84'} May 10 16:38:23.992622 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:38:23.992622 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:38:23.993575 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:38:23.995022 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:38:23.995022 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:38:23.995022 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:38:23.995022 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:38:23.995022 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 16:38:23.995022 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 16:38:23.995022 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 16:38:23.995022 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi May 10 16:38:23.995022 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:38:23.995022 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi May 10 16:38:23.995022 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:38:23.995022 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:38:23.995022 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:38:23.995022 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:38:23.995022 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:38:23.995022 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 16:38:23.995022 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi May 10 16:38:23.995022 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-72348214-efab-4873-91e3-7e55e3349e74 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:38:23.996318 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-72348214-efab-4873-91e3-7e55e3349e74 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059977 May 10 16:38:23.996318 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Tue May 10 16:38:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 16:38:24.002197 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-13f5d9a2-fe7b-4e7c-95a0-402f0da67a37 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:24.016250 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-13f5d9a2-fe7b-4e7c-95a0-402f0da67a37 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017599 May 10 16:38:24.016787 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Tue May 10 16:38:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:38:24.025746 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-de92df2c-f840-4869-bfda-269088ae8135 admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:24.039071 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-de92df2c-f840-4869-bfda-269088ae8135 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016742 May 10 16:38:24.039600 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Tue May 10 16:38:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:38:24.048483 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-86efaf96-b2bd-4d98-accc-faf754477e6c admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:24.053960 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.wsgi [None req-86efaf96-b2bd-4d98-accc-faf754477e6c admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-86efaf96-b2bd-4d98-accc-faf754477e6c admin admin] Request method failure captured: May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Accept: application/json May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Accept-Encoding: gzip, deflate May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Connection: keep-alive May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Content-Length: 0 May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Host: 10.222.0.57 May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Openstack-Api-Version: compute 2.90 May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Openstack-System-Scope: None May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: User-Agent: python-novaclient May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Auth-Token: gAAAAABiepT_cgnHM39nPvI4_WmL6F3eD2zoHNbn48Yr6rxLvG2ZHHhv37yLNKvNb1jlzLASkRZ0rxqxLlSR0YpDC088_RBA7me07ayCuyF0-tAhTne3bo3g2TdKnS8DUIlBpsXiIgqrKecce9BkJkdzI38EYwwq_d-Bc9qU_seW6PukUPtBxQo May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Domain-Id: None May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Domain-Name: None May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Identity-Status: Confirmed May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Is-Admin-Project: True May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Openstack-Nova-Api-Version: 2.90 May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Project-Domain-Id: default May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Project-Domain-Name: Default May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Project-Id: 4f2ab0bb70f249b18504d9e6616306cf May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Project-Name: admin May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Role: admin,member,reader May 10 16:38:24.055467 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Roles: admin,member,reader May 10 16:38:24.057000 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:38:24.057000 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Tenant: admin May 10 16:38:24.057000 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Tenant-Id: 4f2ab0bb70f249b18504d9e6616306cf May 10 16:38:24.057000 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Tenant-Name: admin May 10 16:38:24.057000 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-User: admin May 10 16:38:24.057000 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-User-Domain-Id: default May 10 16:38:24.057000 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-User-Domain-Name: Default May 10 16:38:24.057000 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-User-Id: 0464ce0cc2c244588f440cfed98f23ff May 10 16:38:24.057000 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-User-Name: admin May 10 16:38:24.057000 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: method: > May 10 16:38:24.057000 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: exception: Flavor 84 could not be found. May 10 16:38:24.057000 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: action_args: {'id': '84'} May 10 16:38:24.057000 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:38:24.057000 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:38:24.057835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:38:24.058874 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:38:24.058874 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:38:24.058874 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:38:24.058874 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:38:24.058874 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 16:38:24.058874 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 16:38:24.058874 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 16:38:24.058874 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi May 10 16:38:24.058874 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:38:24.058874 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi May 10 16:38:24.058874 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:38:24.058874 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:38:24.058874 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:38:24.058874 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:38:24.058874 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:38:24.058874 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 16:38:24.058874 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi May 10 16:38:24.058874 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-86efaf96-b2bd-4d98-accc-faf754477e6c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:38:24.059973 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-86efaf96-b2bd-4d98-accc-faf754477e6c admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011944 May 10 16:38:24.059973 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Tue May 10 16:38:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 10 16:38:24.932172 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-de92df2c-f840-4869-bfda-269088ae8135 admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:24.933202 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-de92df2c-f840-4869-bfda-269088ae8135 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 May 10 16:38:24.933596 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 16:38:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:38:25.117925 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-ffe2ea13-17e5-417f-9453-4a4abb189414 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:25.123492 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.wsgi [None req-ffe2ea13-17e5-417f-9453-4a4abb189414 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-ffe2ea13-17e5-417f-9453-4a4abb189414 admin admin] Request method failure captured: May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Accept: application/json May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Accept-Encoding: gzip, deflate May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Connection: keep-alive May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Content-Length: 0 May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Host: 10.222.0.57 May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Openstack-Api-Version: compute 2.90 May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Openstack-System-Scope: None May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: User-Agent: python-novaclient May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Auth-Token: gAAAAABiepUApQWFhe82ApaVoei5PzMaiSmzEdsycOkEnjhBFywotOjT4TImC62HncUEqtjbOmnEIik5PLr65kfpvTUz4OcxkxkaBk1FHmWeN6t4yIzzwGnb9v_woabsH2TudC3Tg25JO2qUAQyz3pwqPifTYvBAIO0pj51SEweJ6zgq8Rs2VGI May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Domain-Id: None May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Domain-Name: None May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Identity-Status: Confirmed May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Is-Admin-Project: True May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Openstack-Nova-Api-Version: 2.90 May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Project-Domain-Id: default May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Project-Domain-Name: Default May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Project-Id: 4f2ab0bb70f249b18504d9e6616306cf May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Project-Name: admin May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Role: admin,member,reader May 10 16:38:25.124978 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Roles: admin,member,reader May 10 16:38:25.126531 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:38:25.126531 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Tenant: admin May 10 16:38:25.126531 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Tenant-Id: 4f2ab0bb70f249b18504d9e6616306cf May 10 16:38:25.126531 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-Tenant-Name: admin May 10 16:38:25.126531 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-User: admin May 10 16:38:25.126531 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-User-Domain-Id: default May 10 16:38:25.126531 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-User-Domain-Name: Default May 10 16:38:25.126531 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-User-Id: 0464ce0cc2c244588f440cfed98f23ff May 10 16:38:25.126531 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: X-User-Name: admin May 10 16:38:25.126531 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: method: > May 10 16:38:25.126531 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: exception: Flavor 451 could not be found. May 10 16:38:25.126531 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: action_args: {'id': '451'} May 10 16:38:25.126531 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:38:25.126531 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:38:25.127722 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:38:25.129591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:38:25.129591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:38:25.129591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:38:25.129591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:38:25.129591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 16:38:25.129591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 16:38:25.129591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 16:38:25.129591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi May 10 16:38:25.129591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:38:25.129591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi May 10 16:38:25.129591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:38:25.129591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:38:25.129591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:38:25.129591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:38:25.129591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:38:25.129591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 16:38:25.129591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: ERROR nova.api.openstack.wsgi May 10 16:38:25.129591 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-ffe2ea13-17e5-417f-9453-4a4abb189414 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114580) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:38:25.130861 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-ffe2ea13-17e5-417f-9453-4a4abb189414 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058038 May 10 16:38:25.130861 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Tue May 10 16:38:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 16:38:25.136584 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-f950de38-b675-49e4-9866-a032a4135d90 admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:25.150773 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-f950de38-b675-49e4-9866-a032a4135d90 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017833 May 10 16:38:25.151327 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Tue May 10 16:38:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:38:25.160305 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-49466f11-1bef-41aa-90b8-1d5804545fc7 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:25.173835 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-49466f11-1bef-41aa-90b8-1d5804545fc7 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016993 May 10 16:38:25.174352 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Tue May 10 16:38:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:38:25.183040 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-764705d9-b92b-4588-a5cc-1cda36ffad11 admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:25.188090 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.wsgi [None req-764705d9-b92b-4588-a5cc-1cda36ffad11 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-764705d9-b92b-4588-a5cc-1cda36ffad11 admin admin] Request method failure captured: May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Accept: application/json May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Accept-Encoding: gzip, deflate May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Connection: keep-alive May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Content-Length: 0 May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Host: 10.222.0.57 May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Openstack-Api-Version: compute 2.90 May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Openstack-System-Scope: None May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: User-Agent: python-novaclient May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Auth-Token: gAAAAABiepUApQWFhe82ApaVoei5PzMaiSmzEdsycOkEnjhBFywotOjT4TImC62HncUEqtjbOmnEIik5PLr65kfpvTUz4OcxkxkaBk1FHmWeN6t4yIzzwGnb9v_woabsH2TudC3Tg25JO2qUAQyz3pwqPifTYvBAIO0pj51SEweJ6zgq8Rs2VGI May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Domain-Id: None May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Domain-Name: None May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Identity-Status: Confirmed May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Is-Admin-Project: True May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Openstack-Nova-Api-Version: 2.90 May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Project-Domain-Id: default May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Project-Domain-Name: Default May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Project-Id: 4f2ab0bb70f249b18504d9e6616306cf May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Project-Name: admin May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Role: admin,member,reader May 10 16:38:25.189593 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Roles: admin,member,reader May 10 16:38:25.191829 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4f2ab0bb70f249b18504d9e6616306cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:38:25.191829 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Tenant: admin May 10 16:38:25.191829 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Tenant-Id: 4f2ab0bb70f249b18504d9e6616306cf May 10 16:38:25.191829 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-Tenant-Name: admin May 10 16:38:25.191829 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-User: admin May 10 16:38:25.191829 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-User-Domain-Id: default May 10 16:38:25.191829 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-User-Domain-Name: Default May 10 16:38:25.191829 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-User-Id: 0464ce0cc2c244588f440cfed98f23ff May 10 16:38:25.191829 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: X-User-Name: admin May 10 16:38:25.191829 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: method: > May 10 16:38:25.191829 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: exception: Flavor 451 could not be found. May 10 16:38:25.191829 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: action_args: {'id': '451'} May 10 16:38:25.191829 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:38:25.191829 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:38:25.192849 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:38:25.194136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:38:25.194136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:38:25.194136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:38:25.194136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:38:25.194136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 16:38:25.194136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 16:38:25.194136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 16:38:25.194136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi May 10 16:38:25.194136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:38:25.194136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi May 10 16:38:25.194136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:38:25.194136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:38:25.194136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:38:25.194136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:38:25.194136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:38:25.194136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 16:38:25.194136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: ERROR nova.api.openstack.wsgi May 10 16:38:25.194136 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-764705d9-b92b-4588-a5cc-1cda36ffad11 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114579) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:38:25.195366 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-764705d9-b92b-4588-a5cc-1cda36ffad11 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011263 May 10 16:38:25.195366 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Tue May 10 16:38:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 16:38:26.092154 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-49466f11-1bef-41aa-90b8-1d5804545fc7 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:26.093161 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-49466f11-1bef-41aa-90b8-1d5804545fc7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 10 16:38:26.093586 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 16:38:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:38:26.287280 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-ef1c36eb-6977-4fa2-8fdf-2eb0ae03d7a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:38:26.304244 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-ef1c36eb-6977-4fa2-8fdf-2eb0ae03d7a5 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.067180 May 10 16:38:26.304699 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Tue May 10 16:38:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 16:38:27.186762 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-49466f11-1bef-41aa-90b8-1d5804545fc7 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:27.187796 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-49466f11-1bef-41aa-90b8-1d5804545fc7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 10 16:38:27.188187 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 16:38:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:38:27.374774 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-c464aa33-0870-4bef-93d8-1a3f59ff8f4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:38:27.391092 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-c464aa33-0870-4bef-93d8-1a3f59ff8f4d admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067105 May 10 16:38:27.391627 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Tue May 10 16:38:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:38:28.284938 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-49466f11-1bef-41aa-90b8-1d5804545fc7 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:28.285941 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-49466f11-1bef-41aa-90b8-1d5804545fc7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 10 16:38:28.286333 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 16:38:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:38:28.473094 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-d19402e3-375d-403f-921f-eeaadfae0b8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:38:28.490466 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-d19402e3-375d-403f-921f-eeaadfae0b8c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067509 May 10 16:38:28.491041 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Tue May 10 16:38:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:38:29.379080 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-49466f11-1bef-41aa-90b8-1d5804545fc7 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:29.380088 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-49466f11-1bef-41aa-90b8-1d5804545fc7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 10 16:38:29.380491 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 16:38:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:38:29.565741 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-29e367d3-d998-44ca-8d53-87c951440fa1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:38:29.583648 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-29e367d3-d998-44ca-8d53-87c951440fa1 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068159 May 10 16:38:29.584189 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Tue May 10 16:38:29 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:38:30.471881 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-49466f11-1bef-41aa-90b8-1d5804545fc7 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:30.473490 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-49466f11-1bef-41aa-90b8-1d5804545fc7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002152 May 10 16:38:30.473888 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 16:38:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:38:30.657003 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-1e2d8740-1da9-44f4-8049-45552e2f4ecf admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:38:30.676367 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-1e2d8740-1da9-44f4-8049-45552e2f4ecf admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068835 May 10 16:38:30.676888 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Tue May 10 16:38:30 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:39:32.537890 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-49466f11-1bef-41aa-90b8-1d5804545fc7 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:39:32.538904 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-49466f11-1bef-41aa-90b8-1d5804545fc7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 10 16:39:32.539360 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 930 bytes} [Tue May 10 16:39:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:39:32.595802 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-50e0ccad-81f2-40dd-8e0b-f2cbe44bb11f admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:39:32.614756 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-50e0ccad-81f2-40dd-8e0b-f2cbe44bb11f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069586 May 10 16:39:32.615304 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1291 bytes} [Tue May 10 16:39:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:39:32.637102 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-2636a7e0-40b6-4a29-a8bc-48a1d3783d9f admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:39:32.645068 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-2636a7e0-40b6-4a29-a8bc-48a1d3783d9f admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012150 May 10 16:39:32.645580 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1282 bytes} [Tue May 10 16:39:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:39:32.656421 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-e0127342-0e6a-405d-99a4-540fa4acb06a admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:39:32.664361 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-e0127342-0e6a-405d-99a4-540fa4acb06a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011518 May 10 16:39:32.664871 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1285 bytes} [Tue May 10 16:39:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:39:32.675945 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-3a26b8f2-ecc1-4d62-8ca8-9ecd98410936 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:39:32.683240 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-3a26b8f2-ecc1-4d62-8ca8-9ecd98410936 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010999 May 10 16:39:32.683738 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1285 bytes} [Tue May 10 16:39:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:39:32.694248 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-0c807f4e-de10-40dc-9be8-6b1e3bbcc033 admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:39:32.701416 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-0c807f4e-de10-40dc-9be8-6b1e3bbcc033 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010531 May 10 16:39:32.701923 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1282 bytes} [Tue May 10 16:39:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:42:59.488612 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-3a26b8f2-ecc1-4d62-8ca8-9ecd98410936 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:42:59.489625 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-3a26b8f2-ecc1-4d62-8ca8-9ecd98410936 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 10 16:42:59.490021 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 16:42:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:42:59.755506 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-215a2ab1-4850-4af1-88aa-56cba6579a2f admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:42:59.756678 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:42:59.756678 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: warnings.warn(msg) May 10 16:42:59.757863 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-215a2ab1-4850-4af1-88aa-56cba6579a2f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:42:59.758292 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-215a2ab1-4850-4af1-88aa-56cba6579a2f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:42:59.759311 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-215a2ab1-4850-4af1-88aa-56cba6579a2f admin admin] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:42:59.759731 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-215a2ab1-4850-4af1-88aa-56cba6579a2f admin admin] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:42:59.791742 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-215a2ab1-4850-4af1-88aa-56cba6579a2f admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.146443 May 10 16:42:59.792285 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1193 bytes} [Tue May 10 16:42:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:43:00.686807 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-3a26b8f2-ecc1-4d62-8ca8-9ecd98410936 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:43:00.688362 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-3a26b8f2-ecc1-4d62-8ca8-9ecd98410936 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 10 16:43:00.688754 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 16:43:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:43:00.884450 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-f6a49b75-0b0c-4903-92f7-765cce6e9ccb admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:43:00.885502 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:43:00.885502 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: warnings.warn(msg) May 10 16:43:00.886708 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-f6a49b75-0b0c-4903-92f7-765cce6e9ccb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:43:00.887196 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-f6a49b75-0b0c-4903-92f7-765cce6e9ccb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:43:00.887983 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-f6a49b75-0b0c-4903-92f7-765cce6e9ccb admin admin] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:43:00.888408 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-f6a49b75-0b0c-4903-92f7-765cce6e9ccb admin admin] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:43:00.908486 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-f6a49b75-0b0c-4903-92f7-765cce6e9ccb admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079835 May 10 16:43:00.908968 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1193 bytes} [Tue May 10 16:43:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:43:12.230883 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-3a26b8f2-ecc1-4d62-8ca8-9ecd98410936 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:43:12.231936 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-3a26b8f2-ecc1-4d62-8ca8-9ecd98410936 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 10 16:43:12.232335 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 36/73] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 16:43:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:43:12.421267 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-5d6db357-423b-4376-ba73-644ed2935b18 admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:43:12.422430 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:43:12.422430 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: warnings.warn(msg) May 10 16:43:12.423674 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-5d6db357-423b-4376-ba73-644ed2935b18 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:43:12.424113 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-5d6db357-423b-4376-ba73-644ed2935b18 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:43:12.425171 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-5d6db357-423b-4376-ba73-644ed2935b18 admin admin] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:43:12.425595 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-5d6db357-423b-4376-ba73-644ed2935b18 admin admin] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:43:12.449390 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-5d6db357-423b-4376-ba73-644ed2935b18 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078644 May 10 16:43:12.449865 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 38/74] 10.222.0.57 () {60 vars in 1193 bytes} [Tue May 10 16:43:12 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:43:13.348289 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: DEBUG nova.api.openstack.wsgi [None req-3a26b8f2-ecc1-4d62-8ca8-9ecd98410936 admin admin] Calling method '>' {{(pid=114580) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:43:13.349300 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: INFO nova.api.openstack.requestlog [None req-3a26b8f2-ecc1-4d62-8ca8-9ecd98410936 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 10 16:43:13.349700 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: [pid: 114580|app: 0|req: 37/75] 10.222.0.57 () {56 vars in 1074 bytes} [Tue May 10 16:43:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:43:13.539773 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG nova.api.openstack.wsgi [None req-d7f924d9-d44c-4c53-9d26-0131cf0d0982 admin admin] Calling method '>' {{(pid=114579) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:43:13.543475 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 16:43:13.543475 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: warnings.warn(msg) May 10 16:43:13.543475 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-d7f924d9-d44c-4c53-9d26-0131cf0d0982 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:43:13.543475 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-d7f924d9-d44c-4c53-9d26-0131cf0d0982 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:43:13.543859 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-d7f924d9-d44c-4c53-9d26-0131cf0d0982 admin admin] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:43:13.544132 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: DEBUG oslo_concurrency.lockutils [None req-d7f924d9-d44c-4c53-9d26-0131cf0d0982 admin admin] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114579) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:43:13.566051 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: INFO nova.api.openstack.requestlog [None req-d7f924d9-d44c-4c53-9d26-0131cf0d0982 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079013 May 10 16:43:13.566536 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: [pid: 114579|app: 0|req: 39/76] 10.222.0.57 () {60 vars in 1193 bytes} [Tue May 10 16:43:13 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:44:09.328955 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: Tue May 10 16:44:09 2022 - graceful shutdown triggered... May 10 16:44:09.329091 dv-cinder-841302-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 10 16:44:09.330527 dv-cinder-841302-1-iscsi devstack@n-api.service[114579]: Gracefully killing worker 1 (pid: 114579)... May 10 16:44:09.330985 dv-cinder-841302-1-iscsi devstack@n-api.service[114580]: Gracefully killing worker 2 (pid: 114580)... May 10 16:44:10.330695 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: worker 1 buried after 1 seconds May 10 16:44:10.330695 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: worker 2 buried after 1 seconds May 10 16:44:10.331366 dv-cinder-841302-1-iscsi devstack@n-api.service[114578]: goodbye to uWSGI. May 10 16:44:10.332315 dv-cinder-841302-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 10 16:44:10.332875 dv-cinder-841302-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 10 16:44:10.335639 dv-cinder-841302-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 16:44:10.352603 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 16:44:10.364061 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 16:44:10 2022] *** May 10 16:44:10.364061 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 16:44:10.364061 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 16:44:10.364061 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: nodename: dv-cinder-841302-1-iscsi May 10 16:44:10.364061 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: machine: x86_64 May 10 16:44:10.364061 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: clock source: unix May 10 16:44:10.364061 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: pcre jit disabled May 10 16:44:10.364061 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: detected number of CPU cores: 4 May 10 16:44:10.364061 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: current working directory: / May 10 16:44:10.364061 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: detected binary path: /usr/bin/uwsgi-core May 10 16:44:10.364847 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: your processes number limit is 47680 May 10 16:44:10.364847 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: your memory page size is 4096 bytes May 10 16:44:10.364847 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: detected max file descriptor number: 2048 May 10 16:44:10.364847 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: lock engine: pthread robust mutexes May 10 16:44:10.364847 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: thunder lock: enabled May 10 16:44:10.364847 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 16:44:10.364847 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 16:44:10.412795 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: Python main interpreter initialized at 0x5594efaf49c0 May 10 16:44:10.412795 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: python threads support enabled May 10 16:44:10.412795 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: your server socket listen backlog is limited to 100 connections May 10 16:44:10.412795 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: your mercy for graceful operations on workers is 90 seconds May 10 16:44:10.413249 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: mapped 403077 bytes (393 KB) for 2 cores May 10 16:44:10.413249 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: *** Operational MODE: preforking *** May 10 16:44:10.413525 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: *** uWSGI is running in multiple interpreter mode *** May 10 16:44:10.413525 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: spawned uWSGI master process (pid: 128904) May 10 16:44:10.413729 dv-cinder-841302-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 16:44:10.414343 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: spawned uWSGI worker 1 (pid: 128924, cores: 1) May 10 16:44:10.414869 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: spawned uWSGI worker 2 (pid: 128925, cores: 1) May 10 16:44:10.415170 dv-cinder-841302-1-iscsi devstack@n-api.service[128904]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 16:44:11.632268 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 16:44:11.633440 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 16:44:12.445386 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:44:12.445386 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: from cryptography.utils import int_from_bytes May 10 16:44:12.445721 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:44:12.445721 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: from cryptography.utils import int_from_bytes May 10 16:44:12.445884 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:44:12.445884 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: from cryptography.utils import int_from_bytes May 10 16:44:12.446035 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 16:44:12.446035 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: from cryptography.utils import int_from_bytes May 10 16:44:14.898434 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 16:44:14.899130 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 16:44:14.899275 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 16:44:14.899822 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 16:44:14.900093 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 16:44:14.900489 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.900826 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.901158 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.901488 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.901826 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.902154 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.902484 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.902826 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.903191 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.903461 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.903786 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.904119 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841302-1-iscsi {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.904450 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.904768 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.905089 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.905429 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.905727 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.906060 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.906375 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.906886 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.908296 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.908296 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.908296 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.908677 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.908914 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.909231 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.909560 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.909879 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.910214 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.910546 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.910937 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841302-1-iscsi {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.911301 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.911623 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.911950 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.912376 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.912696 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.913017 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.913350 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.913601 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 16:44:14.914196 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.914386 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 16:44:14.914546 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.914546 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.914867 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 16:44:14.915056 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.915222 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 16:44:14.915428 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.915581 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 16:44:14.915742 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.915897 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.916087 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.916246 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.916409 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.916590 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.916779 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.916928 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.917079 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.917238 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.917382 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.917542 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.917687 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.917831 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.917988 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.918132 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.918281 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.918425 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.918574 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.918719 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.918877 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.919052 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.919203 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.919203 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.919580 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841302-1-iscsi {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.919734 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.919891 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.920048 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.920194 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.920344 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.920495 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.920656 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.920809 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.920960 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.921103 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.921255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.921398 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.921550 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.921709 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.922789 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.922977 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.923161 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.923161 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.923981 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.924134 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.924287 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.924287 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.924580 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.924580 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.925124 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.925275 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.925426 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.925577 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.925728 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.925882 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.926040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.926040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.926320 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.926320 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.926610 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.926764 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.926919 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.927607 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.927699 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841302-1-iscsi {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.927796 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.927887 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.927969 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.928042 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.928113 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.928113 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.928267 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.928348 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.928421 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.928501 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.928587 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.928681 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.928780 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.928942 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.929036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.929129 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.929220 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.929304 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.929304 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.929489 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.929574 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.929657 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.929739 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.929827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.929924 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.930016 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.930242 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.930440 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.930600 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.930765 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.930918 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.931113 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.931394 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.931568 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.931714 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.931868 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.932594 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.932775 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.933025 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.933188 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.933348 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.933512 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.933665 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.933816 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.933970 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.934136 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.934318 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.934480 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.934633 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.934778 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.934926 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.935112 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.935282 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.935430 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.935582 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.935734 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.935886 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.936052 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.936212 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.936363 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.936516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.936660 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.936813 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.936958 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.937110 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.937261 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.937404 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.937566 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.937712 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.937953 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.938121 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.938278 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.938438 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.938583 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.938733 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.938877 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.939111 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.939758 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.939913 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.940065 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.940217 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.940370 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.940521 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.940684 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.940849 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.941010 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.941154 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.941304 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.941544 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.941697 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.941852 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.941997 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.942683 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.942845 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.943117 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.943351 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.943508 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.943660 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.943806 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.943960 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.944104 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.944262 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.944406 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.944550 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.944693 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.944845 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.944997 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.945151 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.945313 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.945458 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.945608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.945760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.945913 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.946067 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.946212 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.946357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.946500 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.946643 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.946799 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.947021 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.947178 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.947342 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.947494 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.947639 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.947795 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.947954 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.948105 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.948256 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.948412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.948557 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.948714 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.948858 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.949017 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.949172 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.949324 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.949476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.949630 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.949783 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.949926 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.950081 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.950225 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.950383 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.950538 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.950688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.950839 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.951003 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.951178 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.951332 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.951478 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.951707 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.951866 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.952022 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.952168 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.952770 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.953013 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.953191 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.953426 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.953592 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.953736 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.953891 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.954036 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.954188 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.954188 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.954518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.954707 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.954854 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.955015 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.955166 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.955329 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.955474 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.955625 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.955777 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.955940 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.956095 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.956245 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.956391 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.956571 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.956731 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.956875 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.957028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.957182 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.957333 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.957486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.957641 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.957806 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.957971 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.958127 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.958272 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.958423 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.958576 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.958720 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.958872 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.959052 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.959202 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.959357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.959510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.959671 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.959839 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.959994 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.960138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.960289 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.960433 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.960577 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.960720 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.960877 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.961028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.961172 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.961316 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.961460 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.961617 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.961856 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.962007 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.962151 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 16:44:14.962295 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.962909 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.963194 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.963356 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.963620 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.963781 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.963934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.963934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.964232 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.964377 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.964541 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.964688 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.964839 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.964998 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.965149 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.965302 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.965447 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.965590 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.965733 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.965888 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.966032 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.966175 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.966328 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.966479 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.966631 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.966789 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.966934 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.967113 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.967259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.967402 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.967554 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.967718 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.967870 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.968033 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.968188 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.968351 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.968510 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.968655 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.968799 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.968943 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.969087 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.969238 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.969401 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.969547 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.969690 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.969833 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.969977 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.970136 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.970414 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.970565 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.970718 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.970875 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.970875 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.971204 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.971360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.971519 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.971670 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.971838 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.972064 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.972234 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.972390 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.972542 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.973077 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.973341 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.973494 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.973672 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.973913 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.974063 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.974208 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.974208 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.974208 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.974208 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.974773 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.974935 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.975114 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.975270 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.975415 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.975568 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.975721 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.975865 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.976015 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.976159 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.976318 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.976471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.976616 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.976759 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.976920 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.977065 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.977065 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.977362 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.977507 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.977651 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.977801 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.977961 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.978123 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.978275 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.978420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.978563 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.978714 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.978877 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.979098 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.979267 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.979413 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.979565 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.979717 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.979861 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.980015 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.980167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.980319 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.980465 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.980609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.980773 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.980918 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.981063 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.981816 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.981982 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.982229 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.982390 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.982535 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.982688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.983637 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.983798 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.984073 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.984237 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.984393 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.984548 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.984769 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.984941 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.985089 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.985241 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.985387 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.985547 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.985701 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.986380 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.986533 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.986689 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.986689 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.986689 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.986689 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.986689 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.986689 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.986689 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.986689 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.987865 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.987865 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.987865 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.987865 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.987865 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.987865 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.987865 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.987865 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.988957 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.988957 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.988957 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.988957 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.988957 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.989650 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.989650 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.989650 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.990091 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.990277 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.990457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.990650 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.990815 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.990998 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.991158 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.991328 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.991480 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.991630 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.991822 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.991989 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.992158 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.992426 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.992594 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.992764 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.992942 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.993430 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.993895 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.994076 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.994337 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.994502 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.994662 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.994814 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.994999 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.995171 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.995323 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.995485 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.995637 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.995785 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.995950 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.996108 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.996108 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.996413 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.996563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.996727 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.996878 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.997021 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.997123 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.997420 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.997525 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.997612 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.997685 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.997755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.997849 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.997935 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.998014 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.998100 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.998185 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.998280 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.998359 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.998589 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.998934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.999282 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:14.999638 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.000055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.000398 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.000733 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.001068 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.001393 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.002331 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.002658 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.003637 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.003963 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.004080 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.004176 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.004261 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.004359 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.004446 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.004537 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.004711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.004799 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.004880 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.004880 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.005029 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.005173 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.005357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.005503 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.005677 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.005818 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.005957 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.006106 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.006330 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.006434 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.006691 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.006784 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.007058 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.007170 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.007375 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.007465 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.007706 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.007807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.008025 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.008132 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.008339 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.008441 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.008653 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.008746 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.008963 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.009069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.009312 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.009409 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.009628 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.009719 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.009944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.010046 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.010271 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.010370 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.010594 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.010691 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.010909 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.011089 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.011261 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.011474 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.011583 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.011816 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.011911 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.012141 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.012223 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.012520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.012625 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.012838 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.012946 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.013154 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.013331 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.013472 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.013679 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.013773 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.014009 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.014105 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.014333 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.014421 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.014661 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.014764 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.015089 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.015204 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.015336 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.015457 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.015646 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.015770 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.015960 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.016054 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.016279 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.016372 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.016626 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.016876 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.016971 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.017242 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.017337 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.017568 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.017661 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.017894 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.017992 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.018219 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.018321 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.018537 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.018640 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.018856 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.018972 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.019216 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.019309 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.019553 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.019660 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.019869 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.019974 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.020184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.020287 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.020496 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.020596 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.020806 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.021096 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.021185 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.021281 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.021418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.021521 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.021728 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.021821 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.022037 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.022139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.022353 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.022454 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.022662 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.022756 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.023028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.023219 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.023321 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.023592 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.023715 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.023910 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.024167 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.024267 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.024373 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.024539 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.024632 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.024833 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.024941 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.025146 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.025230 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.025459 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.025542 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.025769 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.025864 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.026073 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.026155 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.026377 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.026459 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.026723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.026806 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.027467 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.027598 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.027711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.027836 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.027974 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.028085 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.028207 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.028328 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.028458 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.028592 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.028776 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.028991 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.029099 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.029196 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.029288 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.029454 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.029559 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.029773 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.029866 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.030098 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.030191 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.030428 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.030521 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.030732 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.031078 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.031215 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.031397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.031505 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.031711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.031807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.032022 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.032458 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.032567 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.032654 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.032768 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.032851 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.032962 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.033188 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.033299 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.033575 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.033668 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.033881 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.033993 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.034227 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.034349 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.034494 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.034615 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.034856 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.035010 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.035178 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.035271 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.035440 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.035541 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.035747 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.035863 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.036068 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.036162 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.036376 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.036468 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.036684 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.036778 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.036989 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.037083 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.037304 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.041362 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.042855 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.043487 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.043762 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.043882 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.043991 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.044114 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.044204 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.044303 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.044398 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.044483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.044572 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.044670 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.044761 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.044844 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.044933 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.045020 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.045092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.045192 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.045271 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.045347 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.045426 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.045516 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.045609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.045700 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.045783 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.045783 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.045957 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.046060 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.046228 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.046339 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.046482 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.046576 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.046659 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.046749 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.046749 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.046919 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.047030 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.047124 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.047203 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.047273 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.047353 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.047432 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.047516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.047595 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.047678 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.047772 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.047862 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.047862 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.048021 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.048103 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.048197 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.048293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.049504 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.049607 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.049946 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.050039 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.050123 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.050214 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.050305 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.050388 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.050478 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.050561 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.050642 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.050734 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.050817 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.050908 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.051029 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.051117 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.051199 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.051290 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.051374 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.051456 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.051538 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.051626 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.051722 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.051813 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.051902 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.051986 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.052067 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.052144 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.052225 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.052298 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.052375 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.052455 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.052528 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.052606 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.052687 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.052765 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.052837 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.052913 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.052990 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.053068 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.053165 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.053255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.053338 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.053427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.053505 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.053615 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.053745 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.053930 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.054081 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.054243 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.054479 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.054611 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.054813 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.055074 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.055176 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.055277 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.055381 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.055476 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.055675 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.055834 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.055992 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.056126 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.056313 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.056465 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.056646 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.056778 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.056972 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.057114 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.057282 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.057421 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.057590 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.057731 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.057900 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.058038 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.058215 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.058349 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.058520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.058653 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.058835 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.058986 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.059177 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.059385 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.059537 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.059670 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.059807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.059935 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.060076 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.060222 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.060915 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.061060 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.061189 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.061330 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.061460 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.061587 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.061722 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.061850 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.061984 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.062142 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.062267 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.062385 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.062495 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.062610 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.062737 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.062879 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.063041 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.063180 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.063310 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.063436 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.063562 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.063698 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.063863 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.064107 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.064760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.064920 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.065090 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.065231 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.065418 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.065639 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.065779 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.065904 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.066046 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.066175 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.066363 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.066496 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.066688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.066819 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.067026 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.067176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.067344 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.067487 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.067673 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.067803 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.067994 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.068123 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.068317 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.068456 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.068649 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.068794 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.068983 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.069114 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.069329 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.069553 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.069685 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.069827 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.069955 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.070083 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.070244 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.070384 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.070563 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.070703 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.070884 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.071046 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.071231 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.071350 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.071545 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.071689 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.071868 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.072005 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.072191 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.072322 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.072525 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.072663 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.072813 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.072952 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.073120 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.073252 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.073440 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.073570 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.073762 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.073895 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.074077 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.074214 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.074402 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.074541 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.074720 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.074851 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.075088 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.075257 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.075432 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.075565 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.075750 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.075895 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.076079 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.076225 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.076385 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.076515 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.076694 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.076834 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.077006 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.077151 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.077314 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.077455 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.077621 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.077761 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.077945 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.078086 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.078251 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.078383 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.078564 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.078696 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.078875 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.079045 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.079211 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.079343 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.079569 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.079791 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.079923 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.080058 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.080195 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.080379 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.080511 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.080720 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.080864 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.081021 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.081156 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.081336 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.081467 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.081658 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.081799 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.081962 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.082094 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.082286 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.082432 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.082596 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.082736 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.082902 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.083054 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.083241 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.083387 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.083544 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.083683 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.083886 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.084018 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.084190 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.084333 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.084510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.084641 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.084883 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.085018 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.085160 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.085343 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.085477 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.085667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.085799 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.085995 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.086139 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.086330 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.086472 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.086664 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.086801 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.087030 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.087180 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.087350 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.087496 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.087655 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.087787 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.087968 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.088110 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.088273 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.088405 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.088580 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.088712 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.088885 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.089031 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.089196 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.089335 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.089501 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.089718 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.089938 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.090078 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.090207 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.090333 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.090461 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.090589 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.090729 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.090866 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.091041 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.091267 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.091400 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.091603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.091750 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.091927 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.092059 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.092234 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.092365 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.092577 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.092708 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.092882 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.093011 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.093197 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.093334 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.093517 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.093665 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.093834 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.093966 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.094148 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.094287 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.094487 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.094615 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.094772 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.094903 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.095114 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.095282 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.095457 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.095588 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.095780 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.095914 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.096094 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.096235 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.096408 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.096548 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.096725 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.096857 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.097039 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.097177 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.097349 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.097479 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.097670 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.097801 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.097990 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.098131 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.098311 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.098450 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.098625 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.098870 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.099022 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.099236 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.099369 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.099554 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.099698 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.099868 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.100094 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.100226 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.100351 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.100477 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.100644 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.100793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.100939 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.101106 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.101238 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.101419 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.101559 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.101730 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.101874 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.102043 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.102177 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.102375 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.102507 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.102702 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.102845 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.103053 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.103200 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.103393 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.103541 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.103713 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.103846 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.104028 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.104165 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.104342 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.104473 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.104659 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.104799 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.104971 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.105108 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.105286 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.105427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.105602 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.105735 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.105922 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.106057 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.106233 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.106378 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.106546 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.106684 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.106859 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.107068 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.107211 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.107354 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.107497 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.107633 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.107808 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.107947 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.108122 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.108255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.108433 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.108559 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.108745 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.108884 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.109061 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.109201 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.109382 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.109520 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.109712 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.109848 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.110033 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.110242 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.110382 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.110511 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.110659 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.110797 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.110797 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.113391 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.113530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.113660 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.113796 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.113934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.114063 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.114188 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.114322 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.114458 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.114586 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.114732 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.114868 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.115023 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.115153 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.115288 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.115415 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.115558 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.115686 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.115815 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.115941 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.116068 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.116193 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.116329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.116457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.116584 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.116718 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.116855 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.116855 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.117108 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.117244 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.117378 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.117512 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.117639 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.117779 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.117917 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.118046 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.118172 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.118172 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.118419 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.118556 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.118683 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.118818 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.118955 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.119141 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.119278 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.119415 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.119543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.119669 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.119804 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.119932 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.120068 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.120249 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.120397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.120589 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.120694 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.120938 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.121046 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.121266 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.121376 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.121585 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.121688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.121886 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.121990 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.122195 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.122310 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.122510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.122623 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.122819 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.122924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.123152 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.123247 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.123465 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.123559 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.123772 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.123874 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.124102 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.124220 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.124412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.124513 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.124719 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.124815 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.125028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.125123 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.125340 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.125457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.125646 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.125748 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.125952 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.126045 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.126264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.126430 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.127198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.127334 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.127521 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.127657 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.127830 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.127973 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.128144 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.128283 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.128452 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.128597 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.128768 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.128909 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.129075 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.129215 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.129388 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.129756 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.129897 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.130082 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.130392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.130515 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.130700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.130855 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.131086 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.131412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.131585 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.131762 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.131906 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.132181 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.132328 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.132503 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.132629 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.132856 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.132987 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.133178 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.133318 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.133499 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.133824 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.134068 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.134255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.134451 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.134571 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.134787 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.135018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.135141 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.135387 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.135547 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.135750 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.135890 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.136018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.136145 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.136340 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.136604 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.136739 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.136969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.137102 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.137289 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.137433 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.137607 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.137746 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.137922 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.138064 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.138239 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.138385 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.138555 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.138694 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.138869 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.139028 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.139217 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.139359 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.139531 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.139662 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.139842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.139975 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.140153 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.140293 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.140467 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.140604 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.140780 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.140888 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.141095 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.141207 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.141412 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.141515 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.141729 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.141831 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.142070 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.142176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.142385 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.142491 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.142718 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.142841 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.143057 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.143213 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.143374 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.143515 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.143687 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.143828 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.144002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.144134 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.144314 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.144445 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.144629 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.144763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.144946 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.145087 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.145254 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.145392 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.145573 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.145732 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.145873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.146001 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.146199 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.146331 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.146514 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.146651 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.146837 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.146996 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.147176 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.147323 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.147504 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.147635 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.147862 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.147994 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.148185 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.148324 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.148496 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.148635 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.148813 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.148936 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.149142 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.149242 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.149462 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.149580 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.149790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.149892 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.150121 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.150256 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.150411 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.150569 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.150773 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.150928 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.151091 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.151233 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.151363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.151639 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.151780 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.151950 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.152090 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.152260 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.152403 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.152573 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.152713 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.152877 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.153008 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.153183 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.153324 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.153491 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.153624 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.153800 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.153942 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.154111 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.154243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.154417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.154557 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.154723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.154863 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.155062 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.155207 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.155369 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.155501 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.155675 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.155892 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.156030 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.156164 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.156292 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.156419 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.156570 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.156719 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.156879 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.157011 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.157183 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.157315 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.157488 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.157628 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.157816 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.157950 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.158154 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.158287 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.158489 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.158622 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.158807 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.158948 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.159158 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.159291 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.159473 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.159613 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.159797 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.159930 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.160111 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.160277 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.160419 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.160546 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.160811 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.160961 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.161090 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.161216 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.161366 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.161496 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.161700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.161833 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.162013 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.162160 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.162324 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.162455 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.162639 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.162772 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.162953 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.163104 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.163288 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.163422 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.163603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.163735 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.163934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.164067 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.164264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.164405 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.164600 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.164737 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.164905 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.165046 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.165227 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.165358 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.165551 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.165692 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.165871 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.166002 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.166187 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.166332 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.166518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.166662 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.166837 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.166987 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.167185 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.167328 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.167505 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.167650 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.167821 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.167945 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.168138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.168277 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.168459 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.168603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.168774 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.168912 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.169087 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.169227 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.169401 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.169532 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.169721 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.169853 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.170034 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.170174 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.170525 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.170676 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.170805 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.171057 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.171197 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.171327 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.171464 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.171591 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.171725 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.171860 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.171988 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.172114 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.172255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.172391 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.172527 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.172663 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128925) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 16:44:15.172799 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.173078 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.173913 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.174226 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.174542 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.175200 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.175517 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.175831 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.176179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.176521 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.176848 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.177181 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.177501 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.177833 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.178155 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.178488 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.178823 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.179176 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.179500 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.179844 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.180165 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.180487 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.180811 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.181135 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.181452 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.181773 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.182113 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.182450 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.182769 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.183145 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.183475 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.183807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.184135 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.184456 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.184796 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.185124 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.185445 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.185770 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.186097 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.186420 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.186748 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.187102 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.187440 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.187775 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.188113 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.188450 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.188808 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.189676 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.190031 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.190372 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.190698 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.191046 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.191367 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 16:44:15.191622 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 16:44:15.197121 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_db.sqlalchemy.engines [None req-1841a6ee-c8e3-4284-8b75-36af4273aa98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128925) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:44:15.214607 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_db.sqlalchemy.engines [None req-5d33a9db-c13d-4791-8a38-5fecdb83f4b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:44:15.260883 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.context [None req-1841a6ee-c8e3-4284-8b75-36af4273aa98 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4d8f7176-9260-4d0a-bdf3-ff932fd2323c(cell1) {{(pid=128925) load_cells /opt/stack/nova/nova/context.py:464}} May 10 16:44:15.265283 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1841a6ee-c8e3-4284-8b75-36af4273aa98 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:44:15.266853 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1841a6ee-c8e3-4284-8b75-36af4273aa98 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:44:15.267745 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1841a6ee-c8e3-4284-8b75-36af4273aa98 None None] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:44:15.269643 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1841a6ee-c8e3-4284-8b75-36af4273aa98 None None] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:44:15.279415 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.context [None req-5d33a9db-c13d-4791-8a38-5fecdb83f4b8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4d8f7176-9260-4d0a-bdf3-ff932fd2323c(cell1) {{(pid=128924) load_cells /opt/stack/nova/nova/context.py:464}} May 10 16:44:15.280647 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_db.sqlalchemy.engines [None req-1841a6ee-c8e3-4284-8b75-36af4273aa98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128925) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:44:15.281877 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_db.sqlalchemy.engines [None req-1841a6ee-c8e3-4284-8b75-36af4273aa98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128925) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:44:15.284793 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5d33a9db-c13d-4791-8a38-5fecdb83f4b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:44:15.286449 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5d33a9db-c13d-4791-8a38-5fecdb83f4b8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:44:15.287296 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5d33a9db-c13d-4791-8a38-5fecdb83f4b8 None None] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:44:15.289253 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5d33a9db-c13d-4791-8a38-5fecdb83f4b8 None None] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:44:15.303042 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_db.sqlalchemy.engines [None req-5d33a9db-c13d-4791-8a38-5fecdb83f4b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:44:15.305520 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_db.sqlalchemy.engines [None req-5d33a9db-c13d-4791-8a38-5fecdb83f4b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:44:15.442770 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_db.sqlalchemy.engines [None req-1841a6ee-c8e3-4284-8b75-36af4273aa98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128925) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:44:15.465301 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_db.sqlalchemy.engines [None req-5d33a9db-c13d-4791-8a38-5fecdb83f4b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 16:44:15.764720 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: WARNING keystonemiddleware.auth_token [None req-1841a6ee-c8e3-4284-8b75-36af4273aa98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 16:44:15.772461 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: WARNING keystonemiddleware.auth_token [None req-1841a6ee-c8e3-4284-8b75-36af4273aa98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 16:44:15.793877 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: WARNING keystonemiddleware.auth_token [None req-5d33a9db-c13d-4791-8a38-5fecdb83f4b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 16:44:15.801737 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: WARNING keystonemiddleware.auth_token [None req-5d33a9db-c13d-4791-8a38-5fecdb83f4b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 16:44:16.137250 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: WARNING keystonemiddleware.auth_token [None req-1841a6ee-c8e3-4284-8b75-36af4273aa98 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 16:44:16.144036 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: WARNING keystonemiddleware.auth_token [None req-1841a6ee-c8e3-4284-8b75-36af4273aa98 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 16:44:16.149394 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5594efaf49c0 pid: 128925 (default app) May 10 16:44:16.158662 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: WARNING keystonemiddleware.auth_token [None req-5d33a9db-c13d-4791-8a38-5fecdb83f4b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 16:44:16.164845 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: WARNING keystonemiddleware.auth_token [None req-5d33a9db-c13d-4791-8a38-5fecdb83f4b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 16:44:16.170352 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5594efaf49c0 pid: 128924 (default app) May 10 16:44:57.538856 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-6e4f8e4c-44a1-4fe5-9e6e-57a6d73171a9 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Action: 'create', calling method: .version_select at 0x7fdf1bdce280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1503937815"}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:44:58.839323 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c7b04c37-43c4-4a67-99fc-aa5f46a04ba7 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] Action: 'create', calling method: .version_select at 0x7fdf1bdcd280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-947171705", "metadata": {"Type": "work"}}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c7b04c37-43c4-4a67-99fc-aa5f46a04ba7 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] Request method failure captured: May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept: application/json May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Connection: close May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Length: 121 May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Host: 10.222.0.57 May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABiepaJFOTuyVr5z4P65HhxiUob_3h1-fMqI7c4kmoNU8DhaPo-bFY7i-svpiHJIPoHV9-Jq-QiqBWzLOs87n5vLcrMYPaA9mCC7u6Tk91mQjPGPGPLB2SK2xELK_cuUiBepJrbs248y1m-vP8wxm2x-dF0-8ARFuVZ3rW56CZ7LzVHd3E May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Id: 84172cfab2284ba996a1bac10e937022 May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-VolumesNegativeTest-1757037788 May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 10 16:44:58.857357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 10 16:44:58.859466 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/84172cfab2284ba996a1bac10e937022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/84172cfab2284ba996a1bac10e937022"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/84172cfab2284ba996a1bac10e937022"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_84172cfab2284ba996a1bac10e937022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:44:58.859466 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-VolumesNegativeTest-1757037788 May 10 16:44:58.859466 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 84172cfab2284ba996a1bac10e937022 May 10 16:44:58.859466 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-VolumesNegativeTest-1757037788 May 10 16:44:58.859466 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User: tempest-VolumesNegativeTest-1757037788-project May 10 16:44:58.859466 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 10 16:44:58.859466 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 10 16:44:58.859466 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Id: 0a6bd960c8a34c0b87342e82cebac065 May 10 16:44:58.859466 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-VolumesNegativeTest-1757037788-project May 10 16:44:58.859466 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: May 10 16:44:58.859466 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-947171705", "metadata": {"Type": "work"}}} May 10 16:44:58.859466 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: method: May 10 16:44:58.859466 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-947171705', 'metadata': {'Type': 'work'}}}} May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise error May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi '#$%' May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:44:58.860509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 16:44:58.862139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 16:44:58.867849 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 16:44:58.867849 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:58.867849 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c7b04c37-43c4-4a67-99fc-aa5f46a04ba7 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:44:58.867849 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c7b04c37-43c4-4a67-99fc-aa5f46a04ba7 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.065930 May 10 16:44:58.867849 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1155 bytes} [Tue May 10 16:44:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1070 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 16:44:58.869682 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-428b27f4-1a68-49d2-ba37-f157f081e1b2 tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] Calling method '.version_select at 0x7fdf1bc63670>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:44:59.215906 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-6e4f8e4c-44a1-4fe5-9e6e-57a6d73171a9 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.738396 May 10 16:44:59.216708 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 1/2] 10.222.0.57 () {60 vars in 1154 bytes} [Tue May 10 16:44:56 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2741 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 16:44:59.234469 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-ded9622a-134b-494b-be03-961ccedd439b tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] Action: 'create', calling method: .version_select at 0x7fdf1bc261f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-126016936", "metadata": {"Type": "work"}}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-ded9622a-134b-494b-be03-961ccedd439b tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] Request method failure captured: May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 119 May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepaJFOTuyVr5z4P65HhxiUob_3h1-fMqI7c4kmoNU8DhaPo-bFY7i-svpiHJIPoHV9-Jq-QiqBWzLOs87n5vLcrMYPaA9mCC7u6Tk91mQjPGPGPLB2SK2xELK_cuUiBepJrbs248y1m-vP8wxm2x-dF0-8ARFuVZ3rW56CZ7LzVHd3E May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: 84172cfab2284ba996a1bac10e937022 May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-VolumesNegativeTest-1757037788 May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:44:59.251412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:44:59.253016 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/84172cfab2284ba996a1bac10e937022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/84172cfab2284ba996a1bac10e937022"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/84172cfab2284ba996a1bac10e937022"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_84172cfab2284ba996a1bac10e937022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:44:59.253016 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-VolumesNegativeTest-1757037788 May 10 16:44:59.253016 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: 84172cfab2284ba996a1bac10e937022 May 10 16:44:59.253016 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-VolumesNegativeTest-1757037788 May 10 16:44:59.253016 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-VolumesNegativeTest-1757037788-project May 10 16:44:59.253016 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:44:59.253016 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:44:59.253016 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: 0a6bd960c8a34c0b87342e82cebac065 May 10 16:44:59.253016 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-VolumesNegativeTest-1757037788-project May 10 16:44:59.253016 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: May 10 16:44:59.253016 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-126016936", "metadata": {"Type": "work"}}} May 10 16:44:59.253016 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: May 10 16:44:59.253016 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-126016936', 'metadata': {'Type': 'work'}}}} May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise error May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi '0' May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:44:59.254092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 16:44:59.255723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 16:44:59.257136 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 16:44:59.257136 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:44:59.257136 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-ded9622a-134b-494b-be03-961ccedd439b tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:44:59.257136 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-ded9622a-134b-494b-be03-961ccedd439b tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.037381 May 10 16:44:59.260275 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 2/3] 10.222.0.57 () {60 vars in 1155 bytes} [Tue May 10 16:44:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 16:44:59.264914 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-eadc8bff-1da6-4811-bcc1-07b220df4564 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1bc26310>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:44:59.420867 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-428b27f4-1a68-49d2-ba37-f157f081e1b2 tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/45c12cf9-9adb-4883-9ea1-8dc5dc8dd460" status: 200 len: 350 microversion: 2.1 time: 0.555745 May 10 16:44:59.421504 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 16:44:58 2022] GET /compute/v2.1/os-volumes/45c12cf9-9adb-4883-9ea1-8dc5dc8dd460 => generated 350 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:44:59.437583 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-67ba2fa9-3463-4dd5-a29e-c020cc3aeb57 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] Action: 'create', calling method: .version_select at 0x7fdf1bc51700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-306908125", "metadata": {"Type": "work"}}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-67ba2fa9-3463-4dd5-a29e-c020cc3aeb57 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] Request method failure captured: May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept: application/json May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Connection: close May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Length: 118 May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Host: 10.222.0.57 May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABiepaJFOTuyVr5z4P65HhxiUob_3h1-fMqI7c4kmoNU8DhaPo-bFY7i-svpiHJIPoHV9-Jq-QiqBWzLOs87n5vLcrMYPaA9mCC7u6Tk91mQjPGPGPLB2SK2xELK_cuUiBepJrbs248y1m-vP8wxm2x-dF0-8ARFuVZ3rW56CZ7LzVHd3E May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Id: 84172cfab2284ba996a1bac10e937022 May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-VolumesNegativeTest-1757037788 May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 10 16:44:59.444667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 10 16:44:59.446189 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/84172cfab2284ba996a1bac10e937022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/84172cfab2284ba996a1bac10e937022"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/84172cfab2284ba996a1bac10e937022"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_84172cfab2284ba996a1bac10e937022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:44:59.446189 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-VolumesNegativeTest-1757037788 May 10 16:44:59.446189 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 84172cfab2284ba996a1bac10e937022 May 10 16:44:59.446189 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-VolumesNegativeTest-1757037788 May 10 16:44:59.446189 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User: tempest-VolumesNegativeTest-1757037788-project May 10 16:44:59.446189 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 10 16:44:59.446189 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 10 16:44:59.446189 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Id: 0a6bd960c8a34c0b87342e82cebac065 May 10 16:44:59.446189 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-VolumesNegativeTest-1757037788-project May 10 16:44:59.446189 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: May 10 16:44:59.446189 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-306908125", "metadata": {"Type": "work"}}} May 10 16:44:59.446189 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: method: May 10 16:44:59.446189 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-306908125', 'metadata': {'Type': 'work'}}}} May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise error May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi '' May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:44:59.447179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 16:44:59.448749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 16:44:59.450050 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 16:44:59.450050 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:59.450050 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-67ba2fa9-3463-4dd5-a29e-c020cc3aeb57 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:44:59.450050 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-67ba2fa9-3463-4dd5-a29e-c020cc3aeb57 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017141 May 10 16:44:59.454553 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 3/5] 10.222.0.57 () {60 vars in 1155 bytes} [Tue May 10 16:44:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 16:44:59.465663 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ed2b7c8f-bcba-45f8-bb53-098cf4175930 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] Calling method '.version_select at 0x7fdf1bbde550>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:44:59.483552 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-eadc8bff-1da6-4811-bcc1-07b220df4564 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28" status: 200 len: 346 microversion: 2.1 time: 0.221923 May 10 16:44:59.484558 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 3/6] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 16:44:59 2022] GET /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28 => generated 346 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:44:59.496850 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-72ac527b-53fd-4874-b4a4-88b61a11f997 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Action: 'create', calling method: .version_select at 0x7fdf1bc26040>, body: {"snapshot": {"volume_id": "64ac564d-a1f0-4296-a2ec-21073850da28", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-749138307"}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:44:59.917838 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-ed2b7c8f-bcba-45f8-bb53-098cf4175930 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] HTTP exception thrown: Volume tempest-invalid-1714438203 could not be found. May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ed2b7c8f-bcba-45f8-bb53-098cf4175930 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] Request method failure captured: May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1714438203 HTTP/1.1 May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept: application/json May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Connection: close May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Host: 10.222.0.57 May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABiepaJFOTuyVr5z4P65HhxiUob_3h1-fMqI7c4kmoNU8DhaPo-bFY7i-svpiHJIPoHV9-Jq-QiqBWzLOs87n5vLcrMYPaA9mCC7u6Tk91mQjPGPGPLB2SK2xELK_cuUiBepJrbs248y1m-vP8wxm2x-dF0-8ARFuVZ3rW56CZ7LzVHd3E May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Id: 84172cfab2284ba996a1bac10e937022 May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-VolumesNegativeTest-1757037788 May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 10 16:44:59.921360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 10 16:44:59.922992 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/84172cfab2284ba996a1bac10e937022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/84172cfab2284ba996a1bac10e937022"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/84172cfab2284ba996a1bac10e937022"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_84172cfab2284ba996a1bac10e937022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:44:59.922992 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-VolumesNegativeTest-1757037788 May 10 16:44:59.922992 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 84172cfab2284ba996a1bac10e937022 May 10 16:44:59.922992 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-VolumesNegativeTest-1757037788 May 10 16:44:59.922992 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User: tempest-VolumesNegativeTest-1757037788-project May 10 16:44:59.922992 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 10 16:44:59.922992 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 10 16:44:59.922992 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Id: 0a6bd960c8a34c0b87342e82cebac065 May 10 16:44:59.922992 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-VolumesNegativeTest-1757037788-project May 10 16:44:59.922992 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: method: May 10 16:44:59.922992 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: exception: Volume tempest-invalid-1714438203 could not be found. May 10 16:44:59.922992 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: action_args: {'id': 'tempest-invalid-1714438203'} May 10 16:44:59.922992 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1714438203 could not be found. (HTTP 404) (Request-ID: req-1b590768-2f90-4871-848f-ad230e4aa94e) May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:44:59.923924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 16:44:59.925486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1714438203 could not be found. May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:44:59.926812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1714438203 could not be found. May 10 16:44:59.928138 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:59.928138 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:44:59.928138 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:59.928138 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:44:59.928138 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:44:59.928138 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:44:59.928138 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:44:59.928138 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:44:59.928138 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1714438203 could not be found. May 10 16:44:59.928138 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:44:59.930053 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ed2b7c8f-bcba-45f8-bb53-098cf4175930 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] Returning 404 to user: Volume tempest-invalid-1714438203 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:44:59.931286 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ed2b7c8f-bcba-45f8-bb53-098cf4175930 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1714438203" status: 404 len: 99 microversion: 2.1 time: 0.474558 May 10 16:44:59.936089 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1217 bytes} [Tue May 10 16:44:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1714438203 => generated 99 bytes in 481 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 16:45:00.061612 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-affd2da9-87f1-4aed-b4ed-15616031cdda tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1817228178", "imageRef": "3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b", "flavorRef": "452", "networks": [{"uuid": "38151ffe-5599-4b5d-a8e4-515be172dc1c"}]}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:45:00.298722 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-affd2da9-87f1-4aed-b4ed-15616031cdda tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] validate_networks() for [('38151ffe-5599-4b5d-a8e4-515be172dc1c', None, None, None, None, None)] {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:45:00.323023 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-72ac527b-53fd-4874-b4a4-88b61a11f997 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.830194 May 10 16:45:00.323683 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 4/8] 10.222.0.57 () {60 vars in 1161 bytes} [Tue May 10 16:44:59 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:45:00.329610 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b5ba5f88-b2b9-44c8-855e-59cf54af92e4 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004010 May 10 16:45:00.332167 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 5/9] 10.222.0.57 () {58 vars in 1139 bytes} [Tue May 10 16:45:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 16:45:00.350900 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1f0219a2-6ef2-4cb6-b95c-f34cb9919257 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1bc27ca0>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:00.542905 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-1f0219a2-6ef2-4cb6-b95c-f34cb9919257 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/587e56c2-cf20-4a6a-a0cf-28d6e5d067eb" status: 200 len: 286 microversion: 2.1 time: 0.209503 May 10 16:45:00.544313 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 6/10] 10.222.0.57 () {58 vars in 1250 bytes} [Tue May 10 16:45:00 2022] GET /compute/v2.1/os-snapshots/587e56c2-cf20-4a6a-a0cf-28d6e5d067eb => generated 286 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:00.549644 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-48127f80-2794-45be-912a-4094afb8ccae tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004287 May 10 16:45:00.554410 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 7/11] 10.222.0.57 () {58 vars in 1136 bytes} [Tue May 10 16:45:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 16:45:00.558165 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f98f1088-586e-4a89-8e49-df424f781aef tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1bc278b0>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:00.695729 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-f98f1088-586e-4a89-8e49-df424f781aef tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.141209 May 10 16:45:00.696812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 8/12] 10.222.0.57 () {58 vars in 1139 bytes} [Tue May 10 16:45:00 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:00.702264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b942de38-81a2-454d-b6e9-3370a28b9e31 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] Calling method '.version_select at 0x7fdf1bc260d0>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:00.765044 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.wsgi [None req-b942de38-81a2-454d-b6e9-3370a28b9e31 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] HTTP exception thrown: Volume fed04297-d08d-4d25-adc6-af0a12f7231c could not be found. May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b942de38-81a2-454d-b6e9-3370a28b9e31 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] Request method failure captured: May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: DELETE /compute/v2.1/os-volumes/fed04297-d08d-4d25-adc6-af0a12f7231c HTTP/1.1 May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 0 May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepaJFOTuyVr5z4P65HhxiUob_3h1-fMqI7c4kmoNU8DhaPo-bFY7i-svpiHJIPoHV9-Jq-QiqBWzLOs87n5vLcrMYPaA9mCC7u6Tk91mQjPGPGPLB2SK2xELK_cuUiBepJrbs248y1m-vP8wxm2x-dF0-8ARFuVZ3rW56CZ7LzVHd3E May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: 84172cfab2284ba996a1bac10e937022 May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-VolumesNegativeTest-1757037788 May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:45:00.769008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:45:00.770379 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/84172cfab2284ba996a1bac10e937022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/84172cfab2284ba996a1bac10e937022"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/84172cfab2284ba996a1bac10e937022"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_84172cfab2284ba996a1bac10e937022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:45:00.770379 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-VolumesNegativeTest-1757037788 May 10 16:45:00.770379 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: 84172cfab2284ba996a1bac10e937022 May 10 16:45:00.770379 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-VolumesNegativeTest-1757037788 May 10 16:45:00.770379 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-VolumesNegativeTest-1757037788-project May 10 16:45:00.770379 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:45:00.770379 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:45:00.770379 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: 0a6bd960c8a34c0b87342e82cebac065 May 10 16:45:00.770379 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-VolumesNegativeTest-1757037788-project May 10 16:45:00.770379 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: May 10 16:45:00.770379 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Volume fed04297-d08d-4d25-adc6-af0a12f7231c could not be found. May 10 16:45:00.770379 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'id': 'fed04297-d08d-4d25-adc6-af0a12f7231c'} May 10 16:45:00.770379 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fed04297-d08d-4d25-adc6-af0a12f7231c could not be found. (HTTP 404) (Request-ID: req-28451193-ed49-4c6e-abe5-c0b8ed3936a3) May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:00.771198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 16:45:00.772293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fed04297-d08d-4d25-adc6-af0a12f7231c could not be found. May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 16:45:00.773397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:45:00.774704 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fed04297-d08d-4d25-adc6-af0a12f7231c could not be found. May 10 16:45:00.774704 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:00.774704 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:00.774704 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:00.774704 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:00.774704 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:45:00.774704 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:45:00.774704 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:45:00.774704 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:45:00.774704 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fed04297-d08d-4d25-adc6-af0a12f7231c could not be found. May 10 16:45:00.774704 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:00.777904 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b942de38-81a2-454d-b6e9-3370a28b9e31 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] Returning 404 to user: Volume fed04297-d08d-4d25-adc6-af0a12f7231c could not be found. {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:45:00.778986 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b942de38-81a2-454d-b6e9-3370a28b9e31 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/fed04297-d08d-4d25-adc6-af0a12f7231c" status: 404 len: 109 microversion: 2.1 time: 0.080731 May 10 16:45:00.780092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 9/13] 10.222.0.57 () {58 vars in 1247 bytes} [Tue May 10 16:45:00 2022] DELETE /compute/v2.1/os-volumes/fed04297-d08d-4d25-adc6-af0a12f7231c => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:45:00.790754 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-db8ec288-7f8b-4e00-be1d-b16a9ef15934 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1bd56c10>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:00.869576 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-db8ec288-7f8b-4e00-be1d-b16a9ef15934 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/587e56c2-cf20-4a6a-a0cf-28d6e5d067eb" status: 200 len: 286 microversion: 2.1 time: 0.088223 May 10 16:45:00.870393 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 10/14] 10.222.0.57 () {58 vars in 1250 bytes} [Tue May 10 16:45:00 2022] GET /compute/v2.1/os-snapshots/587e56c2-cf20-4a6a-a0cf-28d6e5d067eb => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:00.876662 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-e0e49083-f541-4619-b7e0-8e0471c56b55 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] Calling method '.version_select at 0x7fdf1bbb9670>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:00.929052 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.wsgi [None req-e0e49083-f541-4619-b7e0-8e0471c56b55 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] HTTP exception thrown: Volume 69a1ac90-f74e-488b-9ccc-c33fc60cda55 could not be found. May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-e0e49083-f541-4619-b7e0-8e0471c56b55 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] Request method failure captured: May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: GET /compute/v2.1/os-volumes/69a1ac90-f74e-488b-9ccc-c33fc60cda55 HTTP/1.1 May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 0 May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepaJFOTuyVr5z4P65HhxiUob_3h1-fMqI7c4kmoNU8DhaPo-bFY7i-svpiHJIPoHV9-Jq-QiqBWzLOs87n5vLcrMYPaA9mCC7u6Tk91mQjPGPGPLB2SK2xELK_cuUiBepJrbs248y1m-vP8wxm2x-dF0-8ARFuVZ3rW56CZ7LzVHd3E May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: 84172cfab2284ba996a1bac10e937022 May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-VolumesNegativeTest-1757037788 May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:45:00.932682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:45:00.934211 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/84172cfab2284ba996a1bac10e937022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/84172cfab2284ba996a1bac10e937022"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/84172cfab2284ba996a1bac10e937022"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_84172cfab2284ba996a1bac10e937022"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:45:00.934211 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-VolumesNegativeTest-1757037788 May 10 16:45:00.934211 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: 84172cfab2284ba996a1bac10e937022 May 10 16:45:00.934211 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-VolumesNegativeTest-1757037788 May 10 16:45:00.934211 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-VolumesNegativeTest-1757037788-project May 10 16:45:00.934211 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:45:00.934211 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:45:00.934211 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: 0a6bd960c8a34c0b87342e82cebac065 May 10 16:45:00.934211 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-VolumesNegativeTest-1757037788-project May 10 16:45:00.934211 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: May 10 16:45:00.934211 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Volume 69a1ac90-f74e-488b-9ccc-c33fc60cda55 could not be found. May 10 16:45:00.934211 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'id': '69a1ac90-f74e-488b-9ccc-c33fc60cda55'} May 10 16:45:00.934211 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 69a1ac90-f74e-488b-9ccc-c33fc60cda55 could not be found. (HTTP 404) (Request-ID: req-ae183fcb-2858-45a1-ac22-f2467e5654e5) May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:00.935125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:45:00.936392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 69a1ac90-f74e-488b-9ccc-c33fc60cda55 could not be found. May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 16:45:00.939975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:45:00.942441 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 69a1ac90-f74e-488b-9ccc-c33fc60cda55 could not be found. May 10 16:45:00.942441 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:00.942441 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:00.942441 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:00.942441 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:00.942441 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:45:00.942441 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:45:00.942441 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:45:00.942441 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:45:00.942441 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 69a1ac90-f74e-488b-9ccc-c33fc60cda55 could not be found. May 10 16:45:00.942441 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:00.946550 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-e0e49083-f541-4619-b7e0-8e0471c56b55 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] Returning 404 to user: Volume 69a1ac90-f74e-488b-9ccc-c33fc60cda55 could not be found. {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:45:00.946550 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-e0e49083-f541-4619-b7e0-8e0471c56b55 tempest-VolumesNegativeTest-1757037788 tempest-VolumesNegativeTest-1757037788-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/69a1ac90-f74e-488b-9ccc-c33fc60cda55" status: 404 len: 109 microversion: 2.1 time: 0.074094 May 10 16:45:00.946550 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 11/15] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 16:45:00 2022] GET /compute/v2.1/os-volumes/69a1ac90-f74e-488b-9ccc-c33fc60cda55 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:45:01.544984 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-affd2da9-87f1-4aed-b4ed-15616031cdda tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:45:01.545531 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-affd2da9-87f1-4aed-b4ed-15616031cdda tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:45:01.546638 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-affd2da9-87f1-4aed-b4ed-15616031cdda tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:45:01.547216 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-affd2da9-87f1-4aed-b4ed-15616031cdda tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:45:01.547874 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-affd2da9-87f1-4aed-b4ed-15616031cdda tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:45:01.575872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-affd2da9-87f1-4aed-b4ed-15616031cdda tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:01.577626 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-affd2da9-87f1-4aed-b4ed-15616031cdda tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:01.579362 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-affd2da9-87f1-4aed-b4ed-15616031cdda tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:01.582990 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-affd2da9-87f1-4aed-b4ed-15616031cdda tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:01.591655 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-aa2e0644-e588-4679-ab36-77ca81b9a0d0 tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] Calling method '.version_select at 0x7fdf1bbb9550>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:01.667217 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-affd2da9-87f1-4aed-b4ed-15616031cdda tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Getting quotas for project e62efa049c3d42a58322385ec167719c. Resources: {'instances', 'cores', 'ram'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:45:01.680032 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-affd2da9-87f1-4aed-b4ed-15616031cdda tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Getting quotas for user e7e31bed346e408e8499bcc6a3397a82 and project e62efa049c3d42a58322385ec167719c. Resources: {'instances', 'cores', 'ram'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:45:01.695822 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-affd2da9-87f1-4aed-b4ed-15616031cdda tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:45:01.698810 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-affd2da9-87f1-4aed-b4ed-15616031cdda tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:45:01.726362 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-aa2e0644-e588-4679-ab36-77ca81b9a0d0 tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/341334a6-c859-4952-884b-7dce41975f63" status: 200 len: 350 microversion: 2.1 time: 0.138944 May 10 16:45:01.736138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 12/16] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 16:45:01 2022] GET /compute/v2.1/os-volumes/341334a6-c859-4952-884b-7dce41975f63 => generated 350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:45:01.856530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-affd2da9-87f1-4aed-b4ed-15616031cdda tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.919037 May 10 16:45:01.857188 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 5/17] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 16:44:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:45:01.867774 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-ee413762-75e0-42ae-81d3-6af8d59eb73a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:01.868875 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-ee413762-75e0-42ae-81d3-6af8d59eb73a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:01.892222 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-357f50c2-3ce8-4378-b8f6-f384168bd58c tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1b2b63a0>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:02.203374 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ee413762-75e0-42ae-81d3-6af8d59eb73a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:02.230886 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-ee413762-75e0-42ae-81d3-6af8d59eb73a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1215 microversion: 2.1 time: 0.363329 May 10 16:45:02.232575 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 13/18] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:01 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1215 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:02.364035 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-357f50c2-3ce8-4378-b8f6-f384168bd58c tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/587e56c2-cf20-4a6a-a0cf-28d6e5d067eb" status: 200 len: 286 microversion: 2.1 time: 0.476008 May 10 16:45:02.364940 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 6/19] 10.222.0.57 () {58 vars in 1250 bytes} [Tue May 10 16:45:01 2022] GET /compute/v2.1/os-snapshots/587e56c2-cf20-4a6a-a0cf-28d6e5d067eb => generated 286 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:03.251199 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-502828b1-ff02-4792-8a43-57fce37e3c88 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:03.251989 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-502828b1-ff02-4792-8a43-57fce37e3c88 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:03.343359 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-502828b1-ff02-4792-8a43-57fce37e3c88 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:03.343359 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-502828b1-ff02-4792-8a43-57fce37e3c88 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1215 microversion: 2.1 time: 0.096606 May 10 16:45:03.346357 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 14/20] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:03 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:03.376602 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-220d6cf7-bdb7-4613-a8a4-015b9c5f51f4 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1b2b6b80>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:03.436635 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-220d6cf7-bdb7-4613-a8a4-015b9c5f51f4 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/587e56c2-cf20-4a6a-a0cf-28d6e5d067eb" status: 200 len: 286 microversion: 2.1 time: 0.064276 May 10 16:45:03.437418 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 7/21] 10.222.0.57 () {58 vars in 1250 bytes} [Tue May 10 16:45:03 2022] GET /compute/v2.1/os-snapshots/587e56c2-cf20-4a6a-a0cf-28d6e5d067eb => generated 286 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:04.362810 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-9ad9a06a-5821-4372-8bd6-56b74ff870ad tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:04.363556 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-9ad9a06a-5821-4372-8bd6-56b74ff870ad tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:04.375455 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9ad9a06a-5821-4372-8bd6-56b74ff870ad tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:04.378012 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9ad9a06a-5821-4372-8bd6-56b74ff870ad tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:04.379964 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9ad9a06a-5821-4372-8bd6-56b74ff870ad tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:04.381332 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9ad9a06a-5821-4372-8bd6-56b74ff870ad tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:04.449555 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-809fb8e6-f93b-4027-99e6-a6e7aeefa7c4 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1b2b6ee0>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:04.522769 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-809fb8e6-f93b-4027-99e6-a6e7aeefa7c4 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/587e56c2-cf20-4a6a-a0cf-28d6e5d067eb" status: 200 len: 287 microversion: 2.1 time: 0.077693 May 10 16:45:04.526251 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 8/22] 10.222.0.57 () {58 vars in 1250 bytes} [Tue May 10 16:45:04 2022] GET /compute/v2.1/os-snapshots/587e56c2-cf20-4a6a-a0cf-28d6e5d067eb => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:45:04.539435 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ef05dfb4-78b6-49ad-a177-fef24344971b tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1b2b6700>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:04.691163 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ef05dfb4-78b6-49ad-a177-fef24344971b tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/587e56c2-cf20-4a6a-a0cf-28d6e5d067eb" status: 202 len: 0 microversion: 2.1 time: 0.156447 May 10 16:45:04.692779 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 9/23] 10.222.0.57 () {58 vars in 1253 bytes} [Tue May 10 16:45:04 2022] DELETE /compute/v2.1/os-snapshots/587e56c2-cf20-4a6a-a0cf-28d6e5d067eb => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:45:04.700657 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-dee84258-46ef-4d71-971c-6fa74917801e tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1b2b6f70>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:04.771265 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-dee84258-46ef-4d71-971c-6fa74917801e tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/587e56c2-cf20-4a6a-a0cf-28d6e5d067eb" status: 200 len: 286 microversion: 2.1 time: 0.075037 May 10 16:45:04.775526 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 10/24] 10.222.0.57 () {58 vars in 1250 bytes} [Tue May 10 16:45:04 2022] GET /compute/v2.1/os-snapshots/587e56c2-cf20-4a6a-a0cf-28d6e5d067eb => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:04.934951 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-721ae219-713a-4e5f-960b-62c9c5370b88 tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] Calling method '.version_select at 0x7fdf1b2b6280>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:05.145372 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-9ad9a06a-5821-4372-8bd6-56b74ff870ad tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:05.185706 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-9ad9a06a-5821-4372-8bd6-56b74ff870ad tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1267 microversion: 2.1 time: 0.826560 May 10 16:45:05.189535 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 15/25] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:04 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1267 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:05.248571 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-721ae219-713a-4e5f-960b-62c9c5370b88 tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/8f7418c8-cb0a-4dba-9224-d4c9c4cc4346" status: 200 len: 351 microversion: 2.1 time: 0.318501 May 10 16:45:05.249337 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 11/26] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 16:45:04 2022] GET /compute/v2.1/os-volumes/8f7418c8-cb0a-4dba-9224-d4c9c4cc4346 => generated 351 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:05.267555 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-a2c3cc6c-91e5-437b-8525-385152f20732 tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] Calling method '.version_select at 0x7fdf1bb02a60>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:05.784065 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-77f87dde-dbd1-4f6b-b291-91710d492506 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1b2b6c10>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:05.878154 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-a2c3cc6c-91e5-437b-8525-385152f20732 tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.620143 May 10 16:45:05.881233 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 16/27] 10.222.0.57 () {58 vars in 1133 bytes} [Tue May 10 16:45:05 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:05.895435 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-c6d65ad5-3c5e-4fd0-b8e8-71c466a5742d tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] Calling method '.version_select at 0x7fdf1bb0aa60>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:05.933569 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-77f87dde-dbd1-4f6b-b291-91710d492506 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] HTTP exception thrown: Snapshot 587e56c2-cf20-4a6a-a0cf-28d6e5d067eb could not be found. May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-77f87dde-dbd1-4f6b-b291-91710d492506 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Request method failure captured: May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/os-snapshots/587e56c2-cf20-4a6a-a0cf-28d6e5d067eb HTTP/1.1 May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept: application/json May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Connection: close May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Host: 10.222.0.57 May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABiepaIfjdUXkXxjke0XyoWxFmucwPOicdqMPvUvnMJXQBDTeeM4W8WXG-Aw56LRBX0XTOj-XWqenulnd8Hj8GYizXSIa8zUxzxWySlzK_bBfiyxgSPaG2uPMRs3n2yDogmuHJQyDk3K7alboj1c2I75DUYY-n9WfKBrkht7Td4xc-PipI May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Id: f97b3ffb197e43f3b3d839655c932d07 May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-601287605 May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 10 16:45:05.936069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 10 16:45:05.937282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f97b3ffb197e43f3b3d839655c932d07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f97b3ffb197e43f3b3d839655c932d07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f97b3ffb197e43f3b3d839655c932d07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f97b3ffb197e43f3b3d839655c932d07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:45:05.937282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-VolumesSnapshotsTestJSON-601287605 May 10 16:45:05.937282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Id: f97b3ffb197e43f3b3d839655c932d07 May 10 16:45:05.937282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-601287605 May 10 16:45:05.937282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User: tempest-VolumesSnapshotsTestJSON-601287605-project May 10 16:45:05.937282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 10 16:45:05.937282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 10 16:45:05.937282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Id: 12295672982a4855b09a742cc5a2d860 May 10 16:45:05.937282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-VolumesSnapshotsTestJSON-601287605-project May 10 16:45:05.937282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: method: May 10 16:45:05.937282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: exception: Snapshot 587e56c2-cf20-4a6a-a0cf-28d6e5d067eb could not be found. May 10 16:45:05.937282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: action_args: {'id': '587e56c2-cf20-4a6a-a0cf-28d6e5d067eb'} May 10 16:45:05.937282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:45:05.938270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:05.938270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 16:45:05.938270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 16:45:05.938270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 16:45:05.938270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 16:45:05.938270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 16:45:05.938270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 16:45:05.938270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:45:05.938270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:45:05.938270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:45:05.938270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:45:05.938270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:45:05.938270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:45:05.938270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:45:05.938270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:45:05.938270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 587e56c2-cf20-4a6a-a0cf-28d6e5d067eb could not be found. (HTTP 404) (Request-ID: req-3102e297-7c03-4dbd-a002-afa1c6feb0b2) May 10 16:45:05.938270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:45:05.938270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:45:05.939457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 587e56c2-cf20-4a6a-a0cf-28d6e5d067eb could not be found. May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 10 16:45:05.940600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:45:05.942175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 587e56c2-cf20-4a6a-a0cf-28d6e5d067eb could not be found. May 10 16:45:05.942175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:45:05.942175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:05.942175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:45:05.942175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:05.942175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:45:05.942175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:45:05.942175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:45:05.942175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:45:05.942175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 587e56c2-cf20-4a6a-a0cf-28d6e5d067eb could not be found. May 10 16:45:05.942175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:45:05.942175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-77f87dde-dbd1-4f6b-b291-91710d492506 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Returning 404 to user: Snapshot 587e56c2-cf20-4a6a-a0cf-28d6e5d067eb could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:45:05.942175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-77f87dde-dbd1-4f6b-b291-91710d492506 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/587e56c2-cf20-4a6a-a0cf-28d6e5d067eb" status: 404 len: 111 microversion: 2.1 time: 0.158322 May 10 16:45:05.942175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 12/28] 10.222.0.57 () {58 vars in 1250 bytes} [Tue May 10 16:45:05 2022] GET /compute/v2.1/os-snapshots/587e56c2-cf20-4a6a-a0cf-28d6e5d067eb => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 16:45:05.946956 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-408f19c3-f661-44c2-9f52-3ff6d0011838 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1bbde3a0>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:06.152619 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-c6d65ad5-3c5e-4fd0-b8e8-71c466a5742d tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.260286 May 10 16:45:06.154226 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 17/29] 10.222.0.57 () {58 vars in 1148 bytes} [Tue May 10 16:45:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:06.171250 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-df3525c4-c0c2-4322-a280-e055969edc23 tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] Calling method '.version_select at 0x7fdf1bac5310>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:06.172576 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-408f19c3-f661-44c2-9f52-3ff6d0011838 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28" status: 202 len: 0 microversion: 2.1 time: 0.229564 May 10 16:45:06.173407 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 13/30] 10.222.0.57 () {58 vars in 1247 bytes} [Tue May 10 16:45:05 2022] DELETE /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:45:06.184471 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ee138288-2bef-41b3-b8a5-44887a690b0d tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1b2b65e0>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:06.342076 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-df3525c4-c0c2-4322-a280-e055969edc23 tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.175589 May 10 16:45:06.343423 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 18/31] 10.222.0.57 () {58 vars in 1133 bytes} [Tue May 10 16:45:06 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:06.353412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-5072c44e-92d5-41e4-b489-ca5939eda893 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:06.354351 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-5072c44e-92d5-41e4-b489-ca5939eda893 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:06.377676 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5072c44e-92d5-41e4-b489-ca5939eda893 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:06.378274 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5072c44e-92d5-41e4-b489-ca5939eda893 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:06.380423 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5072c44e-92d5-41e4-b489-ca5939eda893 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:06.384295 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5072c44e-92d5-41e4-b489-ca5939eda893 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:06.519021 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ee138288-2bef-41b3-b8a5-44887a690b0d tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28" status: 200 len: 345 microversion: 2.1 time: 0.341240 May 10 16:45:06.520039 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 14/32] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 16:45:06 2022] GET /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28 => generated 345 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:06.530055 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b6f1fe05-0d8e-4cd3-bff0-07c24f572ff0 tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] Calling method '.version_select at 0x7fdf1b2c7310>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:06.644157 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-5072c44e-92d5-41e4-b489-ca5939eda893 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:06.664737 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-5072c44e-92d5-41e4-b489-ca5939eda893 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1273 microversion: 2.1 time: 0.319843 May 10 16:45:06.666872 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 19/33] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:06 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1273 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:06.719200 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b6f1fe05-0d8e-4cd3-bff0-07c24f572ff0 tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.197763 May 10 16:45:06.719890 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 15/34] 10.222.0.57 () {58 vars in 1166 bytes} [Tue May 10 16:45:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:06.733003 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-6eb554ce-1c71-4b82-8ef9-8165742eec44 tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] Calling method '.version_select at 0x7fdf1bb94af0>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:06.882920 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-6eb554ce-1c71-4b82-8ef9-8165742eec44 tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.154647 May 10 16:45:06.894656 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 20/35] 10.222.0.57 () {58 vars in 1169 bytes} [Tue May 10 16:45:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:06.896296 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d6911df8-4c61-44e1-bc88-1910c9783180 tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] Calling method '.version_select at 0x7fdf1b2c7d30>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:07.142538 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d6911df8-4c61-44e1-bc88-1910c9783180 tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.250728 May 10 16:45:07.155833 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-4441e78c-4b7e-4482-a944-e4fa4deb2d79 tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] Calling method '.version_select at 0x7fdf1baabee0>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:07.157690 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 16/36] 10.222.0.57 () {58 vars in 1154 bytes} [Tue May 10 16:45:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:07.284801 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-4441e78c-4b7e-4482-a944-e4fa4deb2d79 tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.133133 May 10 16:45:07.287340 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 21/37] 10.222.0.57 () {58 vars in 1187 bytes} [Tue May 10 16:45:07 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:07.304911 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-192d5563-ed78-472f-b254-09f520d4be8b tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] Calling method '.version_select at 0x7fdf1b2c79d0>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:07.438732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-192d5563-ed78-472f-b254-09f520d4be8b tempest-VolumesTestJSON-275930521 tempest-VolumesTestJSON-275930521-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.143908 May 10 16:45:07.439366 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 17/38] 10.222.0.57 () {58 vars in 1154 bytes} [Tue May 10 16:45:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:07.540102 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-e806eabc-0529-4ffd-89a5-aa7131be47e8 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1bac5ca0>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:07.686616 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d0764ef8-f008-4c46-9a22-b080af3fca0e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:07.687402 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d0764ef8-f008-4c46-9a22-b080af3fca0e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:07.710401 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-e806eabc-0529-4ffd-89a5-aa7131be47e8 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28" status: 200 len: 345 microversion: 2.1 time: 0.174948 May 10 16:45:07.711193 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 22/39] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 16:45:07 2022] GET /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28 => generated 345 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:07.749028 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d0764ef8-f008-4c46-9a22-b080af3fca0e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:07.749668 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d0764ef8-f008-4c46-9a22-b080af3fca0e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:07.751189 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d0764ef8-f008-4c46-9a22-b080af3fca0e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:07.751763 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d0764ef8-f008-4c46-9a22-b080af3fca0e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:07.944545 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d0764ef8-f008-4c46-9a22-b080af3fca0e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:07.975600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d0764ef8-f008-4c46-9a22-b080af3fca0e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1273 microversion: 2.1 time: 0.293605 May 10 16:45:07.979006 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 18/40] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:07 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1273 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:45:08.112414 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-4ee3fa73-3172-4eee-8596-4e8c5608d3e3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Action: 'create', calling method: .version_select at 0x7fdf1bac5ee0>, body: {"keypair": {"name": "tempest-keypair-1310767647", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLCZhsJuZ6GGgj7XSZLeVE/yMrj6xz0rh9XS640LLjPAAsnkcvw/dG7R3U/6wtHBxnRtpQwrGKIOrQEHZQV2k/a7Ulq6EpGO6A8Nbvc3+LbmE+YZOA70zLRCkYl5YE07g=="}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:45:08.204373 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-4ee3fa73-3172-4eee-8596-4e8c5608d3e3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Getting quotas for project 3dbc7e862c11480e96d2804301e9796b. Resources: {'key_pairs'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:45:08.213665 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-4ee3fa73-3172-4eee-8596-4e8c5608d3e3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Getting quotas for user 48a7478e69d740e89da1201c954cbfe0 and project 3dbc7e862c11480e96d2804301e9796b. Resources: {'key_pairs'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:45:08.279122 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-4ee3fa73-3172-4eee-8596-4e8c5608d3e3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.358203 May 10 16:45:08.281272 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 23/41] 10.222.0.57 () {62 vars in 1199 bytes} [Tue May 10 16:45:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 361 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 16:45:08.729973 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8f3d444f-b8a0-4362-ac6f-ed6b59e1d20c tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1a9fc8b0>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:08.912210 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8f3d444f-b8a0-4362-ac6f-ed6b59e1d20c tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28" status: 200 len: 345 microversion: 2.1 time: 0.189997 May 10 16:45:08.914126 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 19/42] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 16:45:08 2022] GET /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28 => generated 345 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:09.006902 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-d16b5fa9-6096-407f-bba1-f75fa19061e0 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:09.008032 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-d16b5fa9-6096-407f-bba1-f75fa19061e0 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:09.034717 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d16b5fa9-6096-407f-bba1-f75fa19061e0 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:09.035267 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d16b5fa9-6096-407f-bba1-f75fa19061e0 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:09.037508 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d16b5fa9-6096-407f-bba1-f75fa19061e0 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:09.037980 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d16b5fa9-6096-407f-bba1-f75fa19061e0 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:09.333252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-d16b5fa9-6096-407f-bba1-f75fa19061e0 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:09.356803 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-d16b5fa9-6096-407f-bba1-f75fa19061e0 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1273 microversion: 2.1 time: 0.365734 May 10 16:45:09.358691 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 24/43] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:08 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1273 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:09.478709 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-648136a4-1bee-4038-8c6d-f0d728fc1df3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2087643802", "imageRef": "3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:45:09.674684 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-648136a4-1bee-4038-8c6d-f0d728fc1df3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] validate_networks() for [('b76e54b1-7d46-4b84-b7a6-7fd5103bce00', None, None, None, None, None)] {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:45:09.926696 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-c2766cf5-a022-42e9-9420-51c75bb4e4eb tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1b235a60>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:10.196190 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-c2766cf5-a022-42e9-9420-51c75bb4e4eb tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28" status: 200 len: 345 microversion: 2.1 time: 0.272649 May 10 16:45:10.202907 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 25/44] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 16:45:09 2022] GET /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28 => generated 345 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:45:10.376162 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-05ea9b1f-3352-46ad-9d73-0ec733961d91 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:10.377685 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-05ea9b1f-3352-46ad-9d73-0ec733961d91 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:10.395158 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-05ea9b1f-3352-46ad-9d73-0ec733961d91 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:10.398121 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-05ea9b1f-3352-46ad-9d73-0ec733961d91 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:10.399284 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-05ea9b1f-3352-46ad-9d73-0ec733961d91 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:10.400496 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-05ea9b1f-3352-46ad-9d73-0ec733961d91 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:11.194473 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-05ea9b1f-3352-46ad-9d73-0ec733961d91 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:11.208559 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-05ea9b1f-3352-46ad-9d73-0ec733961d91 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1273 microversion: 2.1 time: 0.837324 May 10 16:45:11.210158 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 26/45] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:10 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1273 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:11.215776 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f235039a-0412-49e1-9e4f-c3ade5bd889d tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1b235dc0>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:11.367602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-f235039a-0412-49e1-9e4f-c3ade5bd889d tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28" status: 200 len: 345 microversion: 2.1 time: 0.155927 May 10 16:45:11.368349 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 27/46] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 16:45:11 2022] GET /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28 => generated 345 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:12.226351 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-7d2a6c41-ee7f-4861-a182-0a652df7f655 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:12.227018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-7d2a6c41-ee7f-4861-a182-0a652df7f655 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:12.243447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7d2a6c41-ee7f-4861-a182-0a652df7f655 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:12.243966 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7d2a6c41-ee7f-4861-a182-0a652df7f655 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:12.244800 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7d2a6c41-ee7f-4861-a182-0a652df7f655 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:12.245261 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7d2a6c41-ee7f-4861-a182-0a652df7f655 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:12.745179 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-648136a4-1bee-4038-8c6d-f0d728fc1df3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:45:12.746573 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-648136a4-1bee-4038-8c6d-f0d728fc1df3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:45:12.749330 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-648136a4-1bee-4038-8c6d-f0d728fc1df3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:45:12.750872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-648136a4-1bee-4038-8c6d-f0d728fc1df3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:45:12.752103 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-648136a4-1bee-4038-8c6d-f0d728fc1df3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:45:12.784194 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-648136a4-1bee-4038-8c6d-f0d728fc1df3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:12.784922 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-648136a4-1bee-4038-8c6d-f0d728fc1df3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:12.789862 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-648136a4-1bee-4038-8c6d-f0d728fc1df3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:12.795321 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-648136a4-1bee-4038-8c6d-f0d728fc1df3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:12.901106 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-648136a4-1bee-4038-8c6d-f0d728fc1df3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Getting quotas for project c0da2d582ad649208e7c4105faee8290. Resources: {'instances', 'cores', 'ram'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:45:12.926391 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-648136a4-1bee-4038-8c6d-f0d728fc1df3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Getting quotas for user de5e76d5385f44fab03527751a478f1e and project c0da2d582ad649208e7c4105faee8290. Resources: {'instances', 'cores', 'ram'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:45:12.985413 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-648136a4-1bee-4038-8c6d-f0d728fc1df3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:45:12.992426 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-648136a4-1bee-4038-8c6d-f0d728fc1df3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:45:13.151398 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-648136a4-1bee-4038-8c6d-f0d728fc1df3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.821358 May 10 16:45:13.155145 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 20/47] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 16:45:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 3826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 16:45:13.172916 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-bd435635-d940-4798-a437-c4eadd7f4b50 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1b2b6ca0>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:13.241928 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-bd435635-d940-4798-a437-c4eadd7f4b50 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] HTTP exception thrown: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-bd435635-d940-4798-a437-c4eadd7f4b50 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Request method failure captured: May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28 HTTP/1.1 May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept: application/json May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Connection: close May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Host: 10.222.0.57 May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABiepaIfjdUXkXxjke0XyoWxFmucwPOicdqMPvUvnMJXQBDTeeM4W8WXG-Aw56LRBX0XTOj-XWqenulnd8Hj8GYizXSIa8zUxzxWySlzK_bBfiyxgSPaG2uPMRs3n2yDogmuHJQyDk3K7alboj1c2I75DUYY-n9WfKBrkht7Td4xc-PipI May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Id: f97b3ffb197e43f3b3d839655c932d07 May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-601287605 May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 10 16:45:13.245040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 10 16:45:13.246483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f97b3ffb197e43f3b3d839655c932d07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f97b3ffb197e43f3b3d839655c932d07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f97b3ffb197e43f3b3d839655c932d07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f97b3ffb197e43f3b3d839655c932d07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:45:13.246483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-VolumesSnapshotsTestJSON-601287605 May 10 16:45:13.246483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Id: f97b3ffb197e43f3b3d839655c932d07 May 10 16:45:13.246483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-601287605 May 10 16:45:13.246483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User: tempest-VolumesSnapshotsTestJSON-601287605-project May 10 16:45:13.246483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 10 16:45:13.246483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 10 16:45:13.246483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Id: 12295672982a4855b09a742cc5a2d860 May 10 16:45:13.246483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-VolumesSnapshotsTestJSON-601287605-project May 10 16:45:13.246483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: method: May 10 16:45:13.246483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: exception: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. May 10 16:45:13.246483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: action_args: {'id': '64ac564d-a1f0-4296-a2ec-21073850da28'} May 10 16:45:13.246483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. (HTTP 404) (Request-ID: req-c7bd03c4-4db0-4f69-bfa5-d16b91eef8c3) May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:13.247282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:45:13.248755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 16:45:13.249873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:45:13.250955 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. May 10 16:45:13.250955 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:45:13.250955 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:13.250955 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:45:13.250955 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:13.250955 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:45:13.250955 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:45:13.250955 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:45:13.250955 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:45:13.250955 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. May 10 16:45:13.250955 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:45:13.252909 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-bd435635-d940-4798-a437-c4eadd7f4b50 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Returning 404 to user: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:45:13.259710 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-bd435635-d940-4798-a437-c4eadd7f4b50 tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28" status: 404 len: 109 microversion: 2.1 time: 0.099490 May 10 16:45:13.260541 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 21/48] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 16:45:13 2022] GET /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:45:13.279959 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-90284e48-fb02-4eaa-a8a3-ba7f414ebc5c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:13.280595 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-90284e48-fb02-4eaa-a8a3-ba7f414ebc5c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:13.606411 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7d2a6c41-ee7f-4861-a182-0a652df7f655 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:13.608018 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-90284e48-fb02-4eaa-a8a3-ba7f414ebc5c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:13.616922 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-7d2a6c41-ee7f-4861-a182-0a652df7f655 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 1.394593 May 10 16:45:13.617864 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 28/49] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:12 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:45:13.630284 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-90284e48-fb02-4eaa-a8a3-ba7f414ebc5c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1222 microversion: 2.1 time: 0.368310 May 10 16:45:13.639923 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 22/50] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:13 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1222 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:13.641296 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-a5933d5b-a5f2-4b62-ad87-13065b19fbcf tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1b235430>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:13.963457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-08cb3fec-9f7b-49e8-83df-897365126fff tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1647063666", "imageRef": "3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:45:13.998886 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.wsgi [None req-a5933d5b-a5f2-4b62-ad87-13065b19fbcf tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] HTTP exception thrown: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-a5933d5b-a5f2-4b62-ad87-13065b19fbcf tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Request method failure captured: May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: DELETE /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28 HTTP/1.1 May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 0 May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepaIfjdUXkXxjke0XyoWxFmucwPOicdqMPvUvnMJXQBDTeeM4W8WXG-Aw56LRBX0XTOj-XWqenulnd8Hj8GYizXSIa8zUxzxWySlzK_bBfiyxgSPaG2uPMRs3n2yDogmuHJQyDk3K7alboj1c2I75DUYY-n9WfKBrkht7Td4xc-PipI May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: f97b3ffb197e43f3b3d839655c932d07 May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-601287605 May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:45:14.001418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:45:14.002457 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f97b3ffb197e43f3b3d839655c932d07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f97b3ffb197e43f3b3d839655c932d07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f97b3ffb197e43f3b3d839655c932d07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f97b3ffb197e43f3b3d839655c932d07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:45:14.002457 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-VolumesSnapshotsTestJSON-601287605 May 10 16:45:14.002457 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: f97b3ffb197e43f3b3d839655c932d07 May 10 16:45:14.002457 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-601287605 May 10 16:45:14.002457 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-VolumesSnapshotsTestJSON-601287605-project May 10 16:45:14.002457 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:45:14.002457 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:45:14.002457 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: 12295672982a4855b09a742cc5a2d860 May 10 16:45:14.002457 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-VolumesSnapshotsTestJSON-601287605-project May 10 16:45:14.002457 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: May 10 16:45:14.002457 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. May 10 16:45:14.002457 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'id': '64ac564d-a1f0-4296-a2ec-21073850da28'} May 10 16:45:14.002457 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. (HTTP 404) (Request-ID: req-44d9791a-90d4-449b-a42e-f2533eeda189) May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:14.003138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 16:45:14.004264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 16:45:14.008447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:45:14.009647 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. May 10 16:45:14.009647 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:14.009647 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:14.009647 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:14.009647 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:14.009647 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:45:14.009647 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:45:14.009647 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:45:14.009647 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:45:14.009647 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. May 10 16:45:14.009647 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:14.009647 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-a5933d5b-a5f2-4b62-ad87-13065b19fbcf tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Returning 404 to user: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:45:14.009647 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-a5933d5b-a5f2-4b62-ad87-13065b19fbcf tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28" status: 404 len: 109 microversion: 2.1 time: 0.383647 May 10 16:45:14.009647 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 29/51] 10.222.0.57 () {58 vars in 1247 bytes} [Tue May 10 16:45:13 2022] DELETE /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28 => generated 109 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:45:14.035182 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-884fde16-3d03-415f-ba04-715c410033cf tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Calling method '.version_select at 0x7fdf1b235e50>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:14.078996 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-08cb3fec-9f7b-49e8-83df-897365126fff tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] validate_networks() for [('b76e54b1-7d46-4b84-b7a6-7fd5103bce00', None, None, None, None, None)] {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:45:14.273396 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.wsgi [None req-884fde16-3d03-415f-ba04-715c410033cf tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] HTTP exception thrown: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-884fde16-3d03-415f-ba04-715c410033cf tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Request method failure captured: May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: GET /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28 HTTP/1.1 May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 0 May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepaIfjdUXkXxjke0XyoWxFmucwPOicdqMPvUvnMJXQBDTeeM4W8WXG-Aw56LRBX0XTOj-XWqenulnd8Hj8GYizXSIa8zUxzxWySlzK_bBfiyxgSPaG2uPMRs3n2yDogmuHJQyDk3K7alboj1c2I75DUYY-n9WfKBrkht7Td4xc-PipI May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: f97b3ffb197e43f3b3d839655c932d07 May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-601287605 May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:45:14.275603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:45:14.276671 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/f97b3ffb197e43f3b3d839655c932d07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f97b3ffb197e43f3b3d839655c932d07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/f97b3ffb197e43f3b3d839655c932d07"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_f97b3ffb197e43f3b3d839655c932d07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:45:14.276671 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-VolumesSnapshotsTestJSON-601287605 May 10 16:45:14.276671 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: f97b3ffb197e43f3b3d839655c932d07 May 10 16:45:14.276671 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-601287605 May 10 16:45:14.276671 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-VolumesSnapshotsTestJSON-601287605-project May 10 16:45:14.276671 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:45:14.276671 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:45:14.276671 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: 12295672982a4855b09a742cc5a2d860 May 10 16:45:14.276671 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-VolumesSnapshotsTestJSON-601287605-project May 10 16:45:14.276671 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: May 10 16:45:14.276671 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. May 10 16:45:14.276671 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'id': '64ac564d-a1f0-4296-a2ec-21073850da28'} May 10 16:45:14.276671 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. (HTTP 404) (Request-ID: req-03ecc41f-b6f0-46bc-9256-1dc4e27514c1) May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:14.277360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:45:14.278427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 16:45:14.279516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:45:14.280478 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. May 10 16:45:14.280478 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:14.280478 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:14.280478 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:14.280478 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:14.280478 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:45:14.280478 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:45:14.280478 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:45:14.280478 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:45:14.280478 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. May 10 16:45:14.280478 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:14.282822 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-884fde16-3d03-415f-ba04-715c410033cf tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] Returning 404 to user: Volume 64ac564d-a1f0-4296-a2ec-21073850da28 could not be found. {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:45:14.283997 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-884fde16-3d03-415f-ba04-715c410033cf tempest-VolumesSnapshotsTestJSON-601287605 tempest-VolumesSnapshotsTestJSON-601287605-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28" status: 404 len: 109 microversion: 2.1 time: 0.275042 May 10 16:45:14.288238 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 30/52] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 16:45:14 2022] GET /compute/v2.1/os-volumes/64ac564d-a1f0-4296-a2ec-21073850da28 => generated 109 bytes in 280 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 16:45:14.638951 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-9791c44f-a7e1-4b5d-b459-2207f9efd26b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:14.639740 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-9791c44f-a7e1-4b5d-b459-2207f9efd26b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:14.668692 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9791c44f-a7e1-4b5d-b459-2207f9efd26b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:14.671339 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9791c44f-a7e1-4b5d-b459-2207f9efd26b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:14.674808 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9791c44f-a7e1-4b5d-b459-2207f9efd26b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:14.675607 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9791c44f-a7e1-4b5d-b459-2207f9efd26b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:15.430301 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-9791c44f-a7e1-4b5d-b459-2207f9efd26b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:15.444033 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-9791c44f-a7e1-4b5d-b459-2207f9efd26b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.807865 May 10 16:45:15.451179 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 31/53] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:14 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:45:15.458736 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-74a06d1c-7b54-4ed3-8692-5bd615a14678 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1446918711", "imageRef": "3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "23609351-96c5-4115-8ab9-1dea233ad75a"}], "security_groups": [{"name": "tempest-securitygroup--171620447"}], "key_name": "tempest-keypair-1310767647", "user_data": "}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:45:16.532490 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.network.neutron [None req-74a06d1c-7b54-4ed3-8692-5bd615a14678 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] validate_networks() for [('23609351-96c5-4115-8ab9-1dea233ad75a', None, None, None, None, None)] {{(pid=128925) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:45:17.580010 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-08cb3fec-9f7b-49e8-83df-897365126fff tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:45:17.580543 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-08cb3fec-9f7b-49e8-83df-897365126fff tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:45:17.580914 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-08cb3fec-9f7b-49e8-83df-897365126fff tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:45:17.581335 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-08cb3fec-9f7b-49e8-83df-897365126fff tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:45:17.581752 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-08cb3fec-9f7b-49e8-83df-897365126fff tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:45:17.613790 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-08cb3fec-9f7b-49e8-83df-897365126fff tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:17.613790 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-08cb3fec-9f7b-49e8-83df-897365126fff tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:17.614291 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-08cb3fec-9f7b-49e8-83df-897365126fff tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:17.622621 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-08cb3fec-9f7b-49e8-83df-897365126fff tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:17.710002 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-08cb3fec-9f7b-49e8-83df-897365126fff tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Getting quotas for project c0da2d582ad649208e7c4105faee8290. Resources: {'instances', 'cores', 'ram'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:45:17.731136 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-08cb3fec-9f7b-49e8-83df-897365126fff tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Getting quotas for user de5e76d5385f44fab03527751a478f1e and project c0da2d582ad649208e7c4105faee8290. Resources: {'instances', 'cores', 'ram'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:45:17.781283 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-08cb3fec-9f7b-49e8-83df-897365126fff tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:45:17.790499 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-08cb3fec-9f7b-49e8-83df-897365126fff tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:45:17.933668 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-08cb3fec-9f7b-49e8-83df-897365126fff tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.974730 May 10 16:45:17.940240 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 23/54] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 16:45:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 3983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 16:45:18.356235 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-4abc6585-ebf9-4997-be82-213685331446 req-bd13ab5d-0939-46b6-aea5-3a0f5a01b29d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbae1dbd-c3ef-4359-862c-9b73b101ef90", "tag": "20a97eae-5fb9-4e5a-b1dd-5a0da85c66c4"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:45:18.388341 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-4abc6585-ebf9-4997-be82-213685331446 req-bd13ab5d-0939-46b6-aea5-3a0f5a01b29d service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:18.388795 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-4abc6585-ebf9-4997-be82-213685331446 req-bd13ab5d-0939-46b6-aea5-3a0f5a01b29d service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:18.466889 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-4abc6585-ebf9-4997-be82-213685331446 req-bd13ab5d-0939-46b6-aea5-3a0f5a01b29d service nova] Creating event network-changed:20a97eae-5fb9-4e5a-b1dd-5a0da85c66c4 for instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 on hv-cinder-84130 May 10 16:45:18.470744 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-4abc6585-ebf9-4997-be82-213685331446 req-bd13ab5d-0939-46b6-aea5-3a0f5a01b29d service nova] Acquired lock "compute-rpcapi-router" {{(pid=128924) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 16:45:18.472665 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9f3fbb35-3d03-48da-a5d0-78b4479739a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:18.475811 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9f3fbb35-3d03-48da-a5d0-78b4479739a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:18.477215 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9f3fbb35-3d03-48da-a5d0-78b4479739a0 None None] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:18.479204 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9f3fbb35-3d03-48da-a5d0-78b4479739a0 None None] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:18.506131 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.compute.rpcapi [None req-9f3fbb35-3d03-48da-a5d0-78b4479739a0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 16:45:18.508717 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9f3fbb35-3d03-48da-a5d0-78b4479739a0 None None] Releasing lock "compute-rpcapi-router" {{(pid=128924) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 16:45:18.547092 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9f3fbb35-3d03-48da-a5d0-78b4479739a0 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.603593 May 10 16:45:18.548144 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 24/55] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:18.553978 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-07e6ecd1-71b8-4734-abd0-7457e58024ca tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:18.556219 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-07e6ecd1-71b8-4734-abd0-7457e58024ca tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:18.579718 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-07e6ecd1-71b8-4734-abd0-7457e58024ca tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:18.580504 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-07e6ecd1-71b8-4734-abd0-7457e58024ca tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:18.587762 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-07e6ecd1-71b8-4734-abd0-7457e58024ca tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:18.591801 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-07e6ecd1-71b8-4734-abd0-7457e58024ca tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:19.689433 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-07e6ecd1-71b8-4734-abd0-7457e58024ca tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:19.699329 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-07e6ecd1-71b8-4734-abd0-7457e58024ca tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 1.149765 May 10 16:45:19.699925 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 25/56] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:18 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:19.715770 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-730146d0-26d5-4e45-841a-a91c2b2c9580 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:19.716484 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-730146d0-26d5-4e45-841a-a91c2b2c9580 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:19.749337 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-730146d0-26d5-4e45-841a-a91c2b2c9580 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:19.752920 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-730146d0-26d5-4e45-841a-a91c2b2c9580 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:19.754352 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-730146d0-26d5-4e45-841a-a91c2b2c9580 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:19.758126 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-730146d0-26d5-4e45-841a-a91c2b2c9580 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:20.152104 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-730146d0-26d5-4e45-841a-a91c2b2c9580 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:20.169345 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-730146d0-26d5-4e45-841a-a91c2b2c9580 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1274 microversion: 2.1 time: 0.467599 May 10 16:45:20.175605 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-74a06d1c-7b54-4ed3-8692-5bd615a14678 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Flavor limits 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:45:20.176116 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-74a06d1c-7b54-4ed3-8692-5bd615a14678 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Image limits 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:45:20.176609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-74a06d1c-7b54-4ed3-8692-5bd615a14678 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Flavor pref 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:45:20.177121 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-74a06d1c-7b54-4ed3-8692-5bd615a14678 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Image pref 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:45:20.177619 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-74a06d1c-7b54-4ed3-8692-5bd615a14678 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:45:20.183001 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 26/57] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:19 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1274 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:20.211990 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-74a06d1c-7b54-4ed3-8692-5bd615a14678 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:20.214199 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-74a06d1c-7b54-4ed3-8692-5bd615a14678 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:20.215078 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-74a06d1c-7b54-4ed3-8692-5bd615a14678 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:20.219931 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-74a06d1c-7b54-4ed3-8692-5bd615a14678 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:20.310751 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-74a06d1c-7b54-4ed3-8692-5bd615a14678 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Getting quotas for project 3dbc7e862c11480e96d2804301e9796b. Resources: {'instances', 'cores', 'ram'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:45:20.329995 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-74a06d1c-7b54-4ed3-8692-5bd615a14678 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Getting quotas for user 48a7478e69d740e89da1201c954cbfe0 and project 3dbc7e862c11480e96d2804301e9796b. Resources: {'instances', 'cores', 'ram'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:45:20.358525 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-74a06d1c-7b54-4ed3-8692-5bd615a14678 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Going to run 1 instances... {{(pid=128925) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:45:20.365767 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-74a06d1c-7b54-4ed3-8692-5bd615a14678 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128925) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:45:20.613388 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-74a06d1c-7b54-4ed3-8692-5bd615a14678 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 5.160805 May 10 16:45:20.614043 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 32/58] 10.222.0.57 () {62 vars in 1187 bytes} [Tue May 10 16:45:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 5162 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 16:45:20.624509 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-9ebab129-1934-45a9-993b-436a95427159 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:20.625159 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-9ebab129-1934-45a9-993b-436a95427159 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:20.957712 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-9ebab129-1934-45a9-993b-436a95427159 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:20.986305 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-9ebab129-1934-45a9-993b-436a95427159 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:20.993166 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-9ebab129-1934-45a9-993b-436a95427159 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:20.995081 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-9ebab129-1934-45a9-993b-436a95427159 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1282 microversion: 2.20 time: 0.374687 May 10 16:45:20.999907 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 33/59] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:20 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1282 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:21.012181 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1bd73a8e-8c69-4626-b93d-c9782026780d tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:21.012811 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-1bd73a8e-8c69-4626-b93d-c9782026780d tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:21.044603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1bd73a8e-8c69-4626-b93d-c9782026780d tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:21.047939 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1bd73a8e-8c69-4626-b93d-c9782026780d tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:21.051197 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1bd73a8e-8c69-4626-b93d-c9782026780d tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:21.051636 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1bd73a8e-8c69-4626-b93d-c9782026780d tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:21.056374 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4e47c747-73a9-4862-8132-05d993dfc8c2 tempest-VolumesGetTestJSON-1654985049 tempest-VolumesGetTestJSON-1654985049-project] Action: 'create', calling method: .version_select at 0x7fdf1a9d7940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-237761494", "metadata": {"Type": "work"}}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:45:22.019501 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4e47c747-73a9-4862-8132-05d993dfc8c2 tempest-VolumesGetTestJSON-1654985049 tempest-VolumesGetTestJSON-1654985049-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.835226 May 10 16:45:22.020482 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 27/60] 10.222.0.57 () {60 vars in 1155 bytes} [Tue May 10 16:45:20 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1837 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 16:45:22.029144 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6cbc5fe4-8f71-4030-a11b-45e9df6dc6e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:22.034078 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6cbc5fe4-8f71-4030-a11b-45e9df6dc6e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:22.062304 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6cbc5fe4-8f71-4030-a11b-45e9df6dc6e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:22.063068 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6cbc5fe4-8f71-4030-a11b-45e9df6dc6e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:22.063787 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6cbc5fe4-8f71-4030-a11b-45e9df6dc6e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:22.064270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6cbc5fe4-8f71-4030-a11b-45e9df6dc6e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:22.346544 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6cbc5fe4-8f71-4030-a11b-45e9df6dc6e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:22.360250 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6cbc5fe4-8f71-4030-a11b-45e9df6dc6e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1280 microversion: 2.1 time: 0.337475 May 10 16:45:22.360906 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 28/61] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:22 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1280 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:22.372711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-1bd73a8e-8c69-4626-b93d-c9782026780d tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:22.375479 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7c54093e-3562-481b-9126-f6abed7e7d91 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:22.376366 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7c54093e-3562-481b-9126-f6abed7e7d91 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:22.381820 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-1bd73a8e-8c69-4626-b93d-c9782026780d tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 1.380589 May 10 16:45:22.389524 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7c54093e-3562-481b-9126-f6abed7e7d91 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:22.389524 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7c54093e-3562-481b-9126-f6abed7e7d91 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:22.389524 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7c54093e-3562-481b-9126-f6abed7e7d91 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:22.389524 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7c54093e-3562-481b-9126-f6abed7e7d91 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:22.393016 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 34/62] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:21 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:22.398374 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-baa8a4c6-2243-4415-a58c-8f13589a7af2 tempest-VolumesGetTestJSON-1654985049 tempest-VolumesGetTestJSON-1654985049-project] Calling method '.version_select at 0x7fdf1b17e430>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:22.548520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-baa8a4c6-2243-4415-a58c-8f13589a7af2 tempest-VolumesGetTestJSON-1654985049 tempest-VolumesGetTestJSON-1654985049-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/eb8700bf-72c6-496b-bb15-d6bc2b7c289d" status: 200 len: 353 microversion: 2.1 time: 0.154293 May 10 16:45:22.549320 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 35/63] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 16:45:22 2022] GET /compute/v2.1/os-volumes/eb8700bf-72c6-496b-bb15-d6bc2b7c289d => generated 353 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:22.567704 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-5df290a9-8c05-4c11-8142-cc83404ef9b2 tempest-VolumesGetTestJSON-1654985049 tempest-VolumesGetTestJSON-1654985049-project] Calling method '.version_select at 0x7fdf1b1fa310>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:22.574059 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7c54093e-3562-481b-9126-f6abed7e7d91 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:22.607622 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7c54093e-3562-481b-9126-f6abed7e7d91 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:22.617123 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7c54093e-3562-481b-9126-f6abed7e7d91 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:22.623087 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7c54093e-3562-481b-9126-f6abed7e7d91 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1278 microversion: 2.20 time: 0.260853 May 10 16:45:22.627007 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 29/64] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:22 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1278 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:22.669462 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-5df290a9-8c05-4c11-8142-cc83404ef9b2 tempest-VolumesGetTestJSON-1654985049 tempest-VolumesGetTestJSON-1654985049-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/eb8700bf-72c6-496b-bb15-d6bc2b7c289d" status: 200 len: 353 microversion: 2.1 time: 0.111824 May 10 16:45:22.671164 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 36/65] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 16:45:22 2022] GET /compute/v2.1/os-volumes/eb8700bf-72c6-496b-bb15-d6bc2b7c289d => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:45:22.688921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9c462a5c-f6ed-4478-8784-49873ffb3626 tempest-VolumesGetTestJSON-1654985049 tempest-VolumesGetTestJSON-1654985049-project] Calling method '.version_select at 0x7fdf1a9d7310>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:22.919459 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9c462a5c-f6ed-4478-8784-49873ffb3626 tempest-VolumesGetTestJSON-1654985049 tempest-VolumesGetTestJSON-1654985049-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/eb8700bf-72c6-496b-bb15-d6bc2b7c289d" status: 202 len: 0 microversion: 2.1 time: 0.235269 May 10 16:45:22.924506 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 30/66] 10.222.0.57 () {58 vars in 1247 bytes} [Tue May 10 16:45:22 2022] DELETE /compute/v2.1/os-volumes/eb8700bf-72c6-496b-bb15-d6bc2b7c289d => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 16:45:22.929717 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-8463717e-4555-4c31-87fc-955d707179c2 tempest-VolumesGetTestJSON-1654985049 tempest-VolumesGetTestJSON-1654985049-project] Calling method '.version_select at 0x7fdf1b1fa8b0>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:23.007572 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-8463717e-4555-4c31-87fc-955d707179c2 tempest-VolumesGetTestJSON-1654985049 tempest-VolumesGetTestJSON-1654985049-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/eb8700bf-72c6-496b-bb15-d6bc2b7c289d" status: 200 len: 352 microversion: 2.1 time: 0.081668 May 10 16:45:23.008135 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 37/67] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 16:45:22 2022] GET /compute/v2.1/os-volumes/eb8700bf-72c6-496b-bb15-d6bc2b7c289d => generated 352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:23.386000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-578b38a1-65e4-42c7-b042-63c5dcd406cf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:23.387291 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-578b38a1-65e4-42c7-b042-63c5dcd406cf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:23.398138 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-578b38a1-65e4-42c7-b042-63c5dcd406cf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:23.398598 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-578b38a1-65e4-42c7-b042-63c5dcd406cf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:23.400504 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-8a72627c-01ab-4265-a9e4-0af1fe9e611f tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:23.401128 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-8a72627c-01ab-4265-a9e4-0af1fe9e611f tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:23.404087 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-578b38a1-65e4-42c7-b042-63c5dcd406cf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:23.405147 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-578b38a1-65e4-42c7-b042-63c5dcd406cf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:23.429215 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8a72627c-01ab-4265-a9e4-0af1fe9e611f tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:23.430541 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8a72627c-01ab-4265-a9e4-0af1fe9e611f tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:23.433722 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8a72627c-01ab-4265-a9e4-0af1fe9e611f tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:23.434573 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8a72627c-01ab-4265-a9e4-0af1fe9e611f tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:24.096628 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-578b38a1-65e4-42c7-b042-63c5dcd406cf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:24.106719 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-578b38a1-65e4-42c7-b042-63c5dcd406cf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.728955 May 10 16:45:24.107775 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 31/68] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:23 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:24.132755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d386f84e-d736-4236-bc12-a6d311dc0d32 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:24.137316 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d386f84e-d736-4236-bc12-a6d311dc0d32 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:24.153724 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d386f84e-d736-4236-bc12-a6d311dc0d32 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:24.166455 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d386f84e-d736-4236-bc12-a6d311dc0d32 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:24.166455 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d386f84e-d736-4236-bc12-a6d311dc0d32 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:24.166455 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d386f84e-d736-4236-bc12-a6d311dc0d32 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:24.189687 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-8a72627c-01ab-4265-a9e4-0af1fe9e611f tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:24.209113 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-8a72627c-01ab-4265-a9e4-0af1fe9e611f tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.809156 May 10 16:45:24.211710 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 38/69] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:23 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:24.223050 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-28463741-11d1-4283-ab5c-02e0739ca697 tempest-VolumesGetTestJSON-1654985049 tempest-VolumesGetTestJSON-1654985049-project] Calling method '.version_select at 0x7fdf1b1fa670>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:24.302464 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.wsgi [None req-28463741-11d1-4283-ab5c-02e0739ca697 tempest-VolumesGetTestJSON-1654985049 tempest-VolumesGetTestJSON-1654985049-project] HTTP exception thrown: Volume eb8700bf-72c6-496b-bb15-d6bc2b7c289d could not be found. May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-28463741-11d1-4283-ab5c-02e0739ca697 tempest-VolumesGetTestJSON-1654985049 tempest-VolumesGetTestJSON-1654985049-project] Request method failure captured: May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: GET /compute/v2.1/os-volumes/eb8700bf-72c6-496b-bb15-d6bc2b7c289d HTTP/1.1 May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 0 May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepafO3S3Kg5Y6booGGTJbf2PkzGm1IGPM7IRwjgRYjyzsH5HYLi_8y5LIiKoULmKNeoKVYhPxnInzHFxkQg2ZBTpjSYutpVk-ryT8r5XgnlBLbzlrXIVYg1yrkE8CPKjT7eiTznnEdFnLyfdrhY1aKx1XfPI9DLF_hdw97nC5gcWL40 May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: 76adee13619c4c18a600704ce4487a8f May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-VolumesGetTestJSON-1654985049 May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:45:24.305252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:45:24.306666 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/76adee13619c4c18a600704ce4487a8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/76adee13619c4c18a600704ce4487a8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/76adee13619c4c18a600704ce4487a8f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_76adee13619c4c18a600704ce4487a8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:45:24.306666 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-VolumesGetTestJSON-1654985049 May 10 16:45:24.306666 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: 76adee13619c4c18a600704ce4487a8f May 10 16:45:24.306666 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-VolumesGetTestJSON-1654985049 May 10 16:45:24.306666 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-VolumesGetTestJSON-1654985049-project May 10 16:45:24.306666 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:45:24.306666 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:45:24.306666 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: 6b160a08080b4ec2bdfc8bf74b18351e May 10 16:45:24.306666 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-VolumesGetTestJSON-1654985049-project May 10 16:45:24.306666 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: May 10 16:45:24.306666 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Volume eb8700bf-72c6-496b-bb15-d6bc2b7c289d could not be found. May 10 16:45:24.306666 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'id': 'eb8700bf-72c6-496b-bb15-d6bc2b7c289d'} May 10 16:45:24.306666 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb8700bf-72c6-496b-bb15-d6bc2b7c289d could not be found. (HTTP 404) (Request-ID: req-b5dd03f6-fdd7-4adf-86b6-636b175b0ff5) May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:24.307608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 16:45:24.308793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb8700bf-72c6-496b-bb15-d6bc2b7c289d could not be found. May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 16:45:24.310648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:45:24.312790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb8700bf-72c6-496b-bb15-d6bc2b7c289d could not be found. May 10 16:45:24.312790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:24.312790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:45:24.312790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:24.312790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:45:24.312790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:45:24.312790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:45:24.312790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:45:24.312790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:45:24.312790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb8700bf-72c6-496b-bb15-d6bc2b7c289d could not be found. May 10 16:45:24.312790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:45:24.312790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-28463741-11d1-4283-ab5c-02e0739ca697 tempest-VolumesGetTestJSON-1654985049 tempest-VolumesGetTestJSON-1654985049-project] Returning 404 to user: Volume eb8700bf-72c6-496b-bb15-d6bc2b7c289d could not be found. {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:45:24.312790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-28463741-11d1-4283-ab5c-02e0739ca697 tempest-VolumesGetTestJSON-1654985049 tempest-VolumesGetTestJSON-1654985049-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/eb8700bf-72c6-496b-bb15-d6bc2b7c289d" status: 404 len: 109 microversion: 2.1 time: 0.093378 May 10 16:45:24.312790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 39/70] 10.222.0.57 () {58 vars in 1244 bytes} [Tue May 10 16:45:24 2022] GET /compute/v2.1/os-volumes/eb8700bf-72c6-496b-bb15-d6bc2b7c289d => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:45:24.377001 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d386f84e-d736-4236-bc12-a6d311dc0d32 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:24.395615 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d386f84e-d736-4236-bc12-a6d311dc0d32 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:24.410394 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d386f84e-d736-4236-bc12-a6d311dc0d32 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:24.415237 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d386f84e-d736-4236-bc12-a6d311dc0d32 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1340 microversion: 2.20 time: 0.306334 May 10 16:45:24.424814 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 32/71] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:24 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1340 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:25.125777 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-970c561a-4654-4588-a011-2c8733d0e333 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:25.126405 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-970c561a-4654-4588-a011-2c8733d0e333 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:25.142867 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-970c561a-4654-4588-a011-2c8733d0e333 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:25.143363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-970c561a-4654-4588-a011-2c8733d0e333 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:25.144179 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-970c561a-4654-4588-a011-2c8733d0e333 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:25.144631 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-970c561a-4654-4588-a011-2c8733d0e333 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:25.232351 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-60d0a09d-35fc-4213-afea-696d40d8821a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:25.234269 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-60d0a09d-35fc-4213-afea-696d40d8821a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:25.251575 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-60d0a09d-35fc-4213-afea-696d40d8821a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:25.252039 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-60d0a09d-35fc-4213-afea-696d40d8821a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:25.255901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-60d0a09d-35fc-4213-afea-696d40d8821a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:25.256548 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-60d0a09d-35fc-4213-afea-696d40d8821a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:25.844783 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-60d0a09d-35fc-4213-afea-696d40d8821a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:25.854189 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-60d0a09d-35fc-4213-afea-696d40d8821a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.631396 May 10 16:45:25.869090 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 33/72] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:25 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:25.889514 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-970c561a-4654-4588-a011-2c8733d0e333 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:25.898504 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-970c561a-4654-4588-a011-2c8733d0e333 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.778133 May 10 16:45:25.909374 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c5dccace-8ead-4a45-a3d0-9dcd95896a73 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:25.912295 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c5dccace-8ead-4a45-a3d0-9dcd95896a73 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:25.912838 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 40/73] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:25 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:25.925763 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c5dccace-8ead-4a45-a3d0-9dcd95896a73 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:25.926335 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c5dccace-8ead-4a45-a3d0-9dcd95896a73 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:25.927473 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c5dccace-8ead-4a45-a3d0-9dcd95896a73 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:25.935058 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c5dccace-8ead-4a45-a3d0-9dcd95896a73 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:26.025712 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c5dccace-8ead-4a45-a3d0-9dcd95896a73 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:26.039220 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c5dccace-8ead-4a45-a3d0-9dcd95896a73 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:26.040827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c5dccace-8ead-4a45-a3d0-9dcd95896a73 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:26.042901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c5dccace-8ead-4a45-a3d0-9dcd95896a73 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1340 microversion: 2.20 time: 0.172493 May 10 16:45:26.045035 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 34/74] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:25 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1340 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:26.192163 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-a0554542-22a0-42d7-89dc-79273f2642f0 req-c81e744e-4228-4e19-8e99-e6fb6d25a747 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7072f21c-b362-4442-9b4e-e7ad82c6ab7d", "tag": "6c9ff718-8934-43ae-8084-2ab8d87294af"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:45:26.214952 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-a0554542-22a0-42d7-89dc-79273f2642f0 req-c81e744e-4228-4e19-8e99-e6fb6d25a747 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:26.215715 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-a0554542-22a0-42d7-89dc-79273f2642f0 req-c81e744e-4228-4e19-8e99-e6fb6d25a747 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:26.255947 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-a0554542-22a0-42d7-89dc-79273f2642f0 req-c81e744e-4228-4e19-8e99-e6fb6d25a747 service nova] Creating event network-changed:6c9ff718-8934-43ae-8084-2ab8d87294af for instance 7072f21c-b362-4442-9b4e-e7ad82c6ab7d on hv-cinder-84130 May 10 16:45:26.257474 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-9dad685e-9d8f-40eb-a070-6fd1f6e5367c req-095319f7-741f-4dae-94b0-3f64f4a47734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21", "tag": "c50b1483-8b5c-448b-bff0-552cf91cad7e"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:45:26.257651 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-a0554542-22a0-42d7-89dc-79273f2642f0 req-c81e744e-4228-4e19-8e99-e6fb6d25a747 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128925) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 16:45:26.259070 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d5c3d9e9-893a-4603-b774-91d2c4beddb0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:26.259687 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d5c3d9e9-893a-4603-b774-91d2c4beddb0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:26.261428 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d5c3d9e9-893a-4603-b774-91d2c4beddb0 None None] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:26.262033 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d5c3d9e9-893a-4603-b774-91d2c4beddb0 None None] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:26.269200 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-9dad685e-9d8f-40eb-a070-6fd1f6e5367c req-095319f7-741f-4dae-94b0-3f64f4a47734 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:26.272803 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-9dad685e-9d8f-40eb-a070-6fd1f6e5367c req-095319f7-741f-4dae-94b0-3f64f4a47734 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:26.278695 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.compute.rpcapi [None req-d5c3d9e9-893a-4603-b774-91d2c4beddb0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 16:45:26.279922 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d5c3d9e9-893a-4603-b774-91d2c4beddb0 None None] Releasing lock "compute-rpcapi-router" {{(pid=128925) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 16:45:26.298585 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-9dad685e-9d8f-40eb-a070-6fd1f6e5367c req-095319f7-741f-4dae-94b0-3f64f4a47734 service nova] Creating event network-changed:c50b1483-8b5c-448b-bff0-552cf91cad7e for instance e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 on hv-cinder-84130 May 10 16:45:26.300477 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-d5c3d9e9-893a-4603-b774-91d2c4beddb0 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.382061 May 10 16:45:26.301083 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 41/75] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:26.312803 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-9dad685e-9d8f-40eb-a070-6fd1f6e5367c req-095319f7-741f-4dae-94b0-3f64f4a47734 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058669 May 10 16:45:26.313711 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 35/76] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:45:26.886085 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-c6ecf16d-fad9-4ffe-9487-7e4402476f58 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:26.889993 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-c6ecf16d-fad9-4ffe-9487-7e4402476f58 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:26.898061 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c6ecf16d-fad9-4ffe-9487-7e4402476f58 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:26.903035 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c6ecf16d-fad9-4ffe-9487-7e4402476f58 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:26.906207 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c6ecf16d-fad9-4ffe-9487-7e4402476f58 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:26.906790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c6ecf16d-fad9-4ffe-9487-7e4402476f58 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:26.921024 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ecced668-b72a-439d-bdbd-844d99916fe3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:26.922287 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ecced668-b72a-439d-bdbd-844d99916fe3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:26.933418 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ecced668-b72a-439d-bdbd-844d99916fe3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:26.933814 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ecced668-b72a-439d-bdbd-844d99916fe3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:26.934603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ecced668-b72a-439d-bdbd-844d99916fe3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:26.935078 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ecced668-b72a-439d-bdbd-844d99916fe3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:27.230170 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c6ecf16d-fad9-4ffe-9487-7e4402476f58 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:27.239980 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-c6ecf16d-fad9-4ffe-9487-7e4402476f58 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.366753 May 10 16:45:27.247833 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 42/77] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:26 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:27.252801 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f33deb36-9997-44b4-b4cf-26abf56e67f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:27.253443 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-f33deb36-9997-44b4-b4cf-26abf56e67f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:27.263189 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f33deb36-9997-44b4-b4cf-26abf56e67f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:27.263638 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f33deb36-9997-44b4-b4cf-26abf56e67f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:27.264471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f33deb36-9997-44b4-b4cf-26abf56e67f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:27.274261 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f33deb36-9997-44b4-b4cf-26abf56e67f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:27.336774 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ecced668-b72a-439d-bdbd-844d99916fe3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:27.345607 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ecced668-b72a-439d-bdbd-844d99916fe3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.428898 May 10 16:45:27.346190 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 36/78] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:26 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:45:27.653262 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f33deb36-9997-44b4-b4cf-26abf56e67f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:27.664430 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f33deb36-9997-44b4-b4cf-26abf56e67f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:27.666801 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f33deb36-9997-44b4-b4cf-26abf56e67f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:27.668343 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-f33deb36-9997-44b4-b4cf-26abf56e67f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.419317 May 10 16:45:27.669567 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 43/79] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:27 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:28.256949 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4c72947c-c00d-4279-9658-4dc004f76ce6 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:28.258413 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4c72947c-c00d-4279-9658-4dc004f76ce6 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:28.274083 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4c72947c-c00d-4279-9658-4dc004f76ce6 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:28.274882 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4c72947c-c00d-4279-9658-4dc004f76ce6 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:28.276483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4c72947c-c00d-4279-9658-4dc004f76ce6 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:28.279552 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4c72947c-c00d-4279-9658-4dc004f76ce6 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:28.367000 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-025aba10-ff00-46c7-a6c5-77005d90987d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:28.368063 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-025aba10-ff00-46c7-a6c5-77005d90987d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:28.391940 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-025aba10-ff00-46c7-a6c5-77005d90987d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:28.400813 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-025aba10-ff00-46c7-a6c5-77005d90987d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:28.402248 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-025aba10-ff00-46c7-a6c5-77005d90987d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:28.402711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-025aba10-ff00-46c7-a6c5-77005d90987d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:29.116438 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-025aba10-ff00-46c7-a6c5-77005d90987d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:29.130183 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-025aba10-ff00-46c7-a6c5-77005d90987d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.765521 May 10 16:45:29.136482 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 44/80] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:28 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:29.147823 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-c86a890c-32ab-4099-aa8c-7bfff2668e58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:29.148446 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-c86a890c-32ab-4099-aa8c-7bfff2668e58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:29.174828 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c86a890c-32ab-4099-aa8c-7bfff2668e58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:29.177688 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c86a890c-32ab-4099-aa8c-7bfff2668e58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:29.179555 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c86a890c-32ab-4099-aa8c-7bfff2668e58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:29.182892 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c86a890c-32ab-4099-aa8c-7bfff2668e58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:29.382645 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4c72947c-c00d-4279-9658-4dc004f76ce6 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:29.395725 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4c72947c-c00d-4279-9658-4dc004f76ce6 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 1.142502 May 10 16:45:29.403463 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 37/81] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:28 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:29.415458 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-67c50c6d-5b3e-4e0e-919f-eb816e72c210 req-d54cd929-e6f6-4a79-92c4-2d44a89f4e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a49eb5-dff1-452f-9e73-a8a9b0c64649", "tag": "0e22ce60-edf0-4181-80b7-08f1d62c396b"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:45:29.455853 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-67c50c6d-5b3e-4e0e-919f-eb816e72c210 req-d54cd929-e6f6-4a79-92c4-2d44a89f4e54 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:29.456450 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-67c50c6d-5b3e-4e0e-919f-eb816e72c210 req-d54cd929-e6f6-4a79-92c4-2d44a89f4e54 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:29.498486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-67c50c6d-5b3e-4e0e-919f-eb816e72c210 req-d54cd929-e6f6-4a79-92c4-2d44a89f4e54 service nova] Creating event network-changed:0e22ce60-edf0-4181-80b7-08f1d62c396b for instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 on hv-cinder-84130 May 10 16:45:29.518242 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-67c50c6d-5b3e-4e0e-919f-eb816e72c210 req-d54cd929-e6f6-4a79-92c4-2d44a89f4e54 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109774 May 10 16:45:29.522708 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 38/82] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:29.746426 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c86a890c-32ab-4099-aa8c-7bfff2668e58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:29.764927 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c86a890c-32ab-4099-aa8c-7bfff2668e58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:29.767809 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c86a890c-32ab-4099-aa8c-7bfff2668e58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:29.776689 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-c86a890c-32ab-4099-aa8c-7bfff2668e58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.631472 May 10 16:45:29.777522 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 45/83] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:29 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:30.144242 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-afa788dc-7356-4e5c-b868-44881ee3b33e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:30.145245 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-afa788dc-7356-4e5c-b868-44881ee3b33e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:30.152365 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-afa788dc-7356-4e5c-b868-44881ee3b33e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:30.152898 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-afa788dc-7356-4e5c-b868-44881ee3b33e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:30.153898 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-afa788dc-7356-4e5c-b868-44881ee3b33e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:30.154343 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-afa788dc-7356-4e5c-b868-44881ee3b33e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:30.339767 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-afa788dc-7356-4e5c-b868-44881ee3b33e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:30.345736 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-afa788dc-7356-4e5c-b868-44881ee3b33e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.206402 May 10 16:45:30.346367 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 39/84] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:30 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:30.417453 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3d62589c-a7ea-4622-bccf-6e26ea26aa6e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:30.419541 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3d62589c-a7ea-4622-bccf-6e26ea26aa6e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:30.427972 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3d62589c-a7ea-4622-bccf-6e26ea26aa6e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:30.428836 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3d62589c-a7ea-4622-bccf-6e26ea26aa6e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:30.430009 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3d62589c-a7ea-4622-bccf-6e26ea26aa6e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:30.431122 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3d62589c-a7ea-4622-bccf-6e26ea26aa6e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:30.605698 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3d62589c-a7ea-4622-bccf-6e26ea26aa6e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:30.616633 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3d62589c-a7ea-4622-bccf-6e26ea26aa6e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.203858 May 10 16:45:30.617622 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 40/85] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:30 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:45:30.637310 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-0a7c31e6-2889-4f76-a019-52b0cea0fc0c req-7b1c7729-eadb-4a2f-aa9b-d2bbf6add8de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbae1dbd-c3ef-4359-862c-9b73b101ef90", "name": "network-vif-plugged", "status": "completed", "tag": "20a97eae-5fb9-4e5a-b1dd-5a0da85c66c4"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:45:30.651630 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-0a7c31e6-2889-4f76-a019-52b0cea0fc0c req-7b1c7729-eadb-4a2f-aa9b-d2bbf6add8de service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:30.652071 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-0a7c31e6-2889-4f76-a019-52b0cea0fc0c req-7b1c7729-eadb-4a2f-aa9b-d2bbf6add8de service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:30.663629 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-0a7c31e6-2889-4f76-a019-52b0cea0fc0c req-7b1c7729-eadb-4a2f-aa9b-d2bbf6add8de service nova] Creating event network-vif-plugged:20a97eae-5fb9-4e5a-b1dd-5a0da85c66c4 for instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 on hv-cinder-84130 May 10 16:45:30.669635 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-0a7c31e6-2889-4f76-a019-52b0cea0fc0c req-7b1c7729-eadb-4a2f-aa9b-d2bbf6add8de service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275128 May 10 16:45:30.670419 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 46/86] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:30.795428 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5035ca2f-1324-4c0c-b597-6d8b04254063 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:30.796059 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5035ca2f-1324-4c0c-b597-6d8b04254063 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:30.802236 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5035ca2f-1324-4c0c-b597-6d8b04254063 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:30.802772 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5035ca2f-1324-4c0c-b597-6d8b04254063 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:30.803635 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5035ca2f-1324-4c0c-b597-6d8b04254063 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:30.804140 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5035ca2f-1324-4c0c-b597-6d8b04254063 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:30.934322 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5035ca2f-1324-4c0c-b597-6d8b04254063 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:30.941950 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5035ca2f-1324-4c0c-b597-6d8b04254063 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:30.943477 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5035ca2f-1324-4c0c-b597-6d8b04254063 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:30.944567 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5035ca2f-1324-4c0c-b597-6d8b04254063 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.153204 May 10 16:45:30.945347 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 41/87] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:30 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:31.362354 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-18252fb5-645c-4e5c-b1d3-e8f4fa891bb1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:31.363108 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-18252fb5-645c-4e5c-b1d3-e8f4fa891bb1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:31.369416 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-18252fb5-645c-4e5c-b1d3-e8f4fa891bb1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:31.369863 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-18252fb5-645c-4e5c-b1d3-e8f4fa891bb1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:31.370644 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-18252fb5-645c-4e5c-b1d3-e8f4fa891bb1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:31.371162 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-18252fb5-645c-4e5c-b1d3-e8f4fa891bb1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:31.504385 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-18252fb5-645c-4e5c-b1d3-e8f4fa891bb1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:31.511883 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-18252fb5-645c-4e5c-b1d3-e8f4fa891bb1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.154104 May 10 16:45:31.512439 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 47/88] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:31 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:31.640418 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9416d3a2-8f11-435f-acc6-73a6bc1e629e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:31.641094 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9416d3a2-8f11-435f-acc6-73a6bc1e629e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:31.647080 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9416d3a2-8f11-435f-acc6-73a6bc1e629e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:31.647519 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9416d3a2-8f11-435f-acc6-73a6bc1e629e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:31.648192 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9416d3a2-8f11-435f-acc6-73a6bc1e629e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:31.648636 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9416d3a2-8f11-435f-acc6-73a6bc1e629e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:31.781789 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9416d3a2-8f11-435f-acc6-73a6bc1e629e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:31.789337 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9416d3a2-8f11-435f-acc6-73a6bc1e629e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.152872 May 10 16:45:31.789907 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 42/89] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:31 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:31.963878 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-ddabae76-effe-421d-bc7a-e1c0b76f1c53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:31.965086 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-ddabae76-effe-421d-bc7a-e1c0b76f1c53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:31.971475 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ddabae76-effe-421d-bc7a-e1c0b76f1c53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:31.971918 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ddabae76-effe-421d-bc7a-e1c0b76f1c53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:31.972675 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ddabae76-effe-421d-bc7a-e1c0b76f1c53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:31.973106 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ddabae76-effe-421d-bc7a-e1c0b76f1c53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:32.117218 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ddabae76-effe-421d-bc7a-e1c0b76f1c53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:32.125537 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ddabae76-effe-421d-bc7a-e1c0b76f1c53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:32.127264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ddabae76-effe-421d-bc7a-e1c0b76f1c53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:32.128373 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-ddabae76-effe-421d-bc7a-e1c0b76f1c53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.168476 May 10 16:45:32.128916 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 48/90] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:31 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:32.528475 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6cfcb7b3-df5a-4851-b12e-40a737f36e63 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:32.529082 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6cfcb7b3-df5a-4851-b12e-40a737f36e63 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:32.534982 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6cfcb7b3-df5a-4851-b12e-40a737f36e63 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:32.535460 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6cfcb7b3-df5a-4851-b12e-40a737f36e63 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:32.536221 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6cfcb7b3-df5a-4851-b12e-40a737f36e63 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:32.536650 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6cfcb7b3-df5a-4851-b12e-40a737f36e63 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:32.677949 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6cfcb7b3-df5a-4851-b12e-40a737f36e63 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:32.685602 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6cfcb7b3-df5a-4851-b12e-40a737f36e63 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.160988 May 10 16:45:32.686317 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 43/91] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:32 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:32.807081 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1348184a-941a-4ba6-b6e1-bf5a4557f853 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:32.807761 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-1348184a-941a-4ba6-b6e1-bf5a4557f853 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:32.814362 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1348184a-941a-4ba6-b6e1-bf5a4557f853 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:32.814888 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1348184a-941a-4ba6-b6e1-bf5a4557f853 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:32.815753 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1348184a-941a-4ba6-b6e1-bf5a4557f853 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:32.816261 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1348184a-941a-4ba6-b6e1-bf5a4557f853 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:32.961168 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-1348184a-941a-4ba6-b6e1-bf5a4557f853 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:32.969797 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-1348184a-941a-4ba6-b6e1-bf5a4557f853 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.167620 May 10 16:45:32.970583 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 49/92] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:32 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:33.145592 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2a608407-6628-4d21-ac10-c815e1f17546 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:33.146293 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2a608407-6628-4d21-ac10-c815e1f17546 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:33.152294 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a608407-6628-4d21-ac10-c815e1f17546 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:33.155627 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a608407-6628-4d21-ac10-c815e1f17546 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:33.157529 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a608407-6628-4d21-ac10-c815e1f17546 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:33.158624 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a608407-6628-4d21-ac10-c815e1f17546 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:33.348220 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2a608407-6628-4d21-ac10-c815e1f17546 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:33.356735 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2a608407-6628-4d21-ac10-c815e1f17546 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:33.358247 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2a608407-6628-4d21-ac10-c815e1f17546 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:33.359426 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2a608407-6628-4d21-ac10-c815e1f17546 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.217702 May 10 16:45:33.359987 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 44/93] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:33 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:33.703093 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-770f05c7-bcb1-4f33-afcf-1762fbdf5660 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:33.703708 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-770f05c7-bcb1-4f33-afcf-1762fbdf5660 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:33.709950 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-770f05c7-bcb1-4f33-afcf-1762fbdf5660 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:33.710071 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-770f05c7-bcb1-4f33-afcf-1762fbdf5660 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:33.710940 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-770f05c7-bcb1-4f33-afcf-1762fbdf5660 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:33.711423 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-770f05c7-bcb1-4f33-afcf-1762fbdf5660 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:33.838388 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-770f05c7-bcb1-4f33-afcf-1762fbdf5660 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:33.845732 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-770f05c7-bcb1-4f33-afcf-1762fbdf5660 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.146847 May 10 16:45:33.846287 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 50/94] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:33 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:33.987301 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f5259382-e0b6-4f54-8db3-b2b44dd06957 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:33.987918 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f5259382-e0b6-4f54-8db3-b2b44dd06957 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:33.993976 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f5259382-e0b6-4f54-8db3-b2b44dd06957 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:33.994428 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f5259382-e0b6-4f54-8db3-b2b44dd06957 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:33.995234 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f5259382-e0b6-4f54-8db3-b2b44dd06957 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:33.995793 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f5259382-e0b6-4f54-8db3-b2b44dd06957 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:34.133595 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f5259382-e0b6-4f54-8db3-b2b44dd06957 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:34.141198 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f5259382-e0b6-4f54-8db3-b2b44dd06957 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.158368 May 10 16:45:34.141781 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 45/95] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:33 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:34.377278 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-cfbebcc5-af55-44f6-a585-8dd773c8e3ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:34.378053 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-cfbebcc5-af55-44f6-a585-8dd773c8e3ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:34.384257 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-cfbebcc5-af55-44f6-a585-8dd773c8e3ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:34.384777 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-cfbebcc5-af55-44f6-a585-8dd773c8e3ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:34.385625 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-cfbebcc5-af55-44f6-a585-8dd773c8e3ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:34.386060 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-cfbebcc5-af55-44f6-a585-8dd773c8e3ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:34.541397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-cfbebcc5-af55-44f6-a585-8dd773c8e3ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:34.551220 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-cfbebcc5-af55-44f6-a585-8dd773c8e3ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:34.552732 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-cfbebcc5-af55-44f6-a585-8dd773c8e3ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:34.554340 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-cfbebcc5-af55-44f6-a585-8dd773c8e3ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.180910 May 10 16:45:34.555108 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 51/96] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:34 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:34.861468 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-248b5a70-5959-488f-844a-844ccefcbd42 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:34.862077 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-248b5a70-5959-488f-844a-844ccefcbd42 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:34.867936 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-248b5a70-5959-488f-844a-844ccefcbd42 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:34.868386 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-248b5a70-5959-488f-844a-844ccefcbd42 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:34.869139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-248b5a70-5959-488f-844a-844ccefcbd42 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:34.869570 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-248b5a70-5959-488f-844a-844ccefcbd42 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:34.997598 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-248b5a70-5959-488f-844a-844ccefcbd42 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:35.006315 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-248b5a70-5959-488f-844a-844ccefcbd42 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.148611 May 10 16:45:35.006889 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 46/97] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:34 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:35.158183 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-7644ba01-a90e-4b26-8869-00fac582b2cf tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:35.160038 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-7644ba01-a90e-4b26-8869-00fac582b2cf tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:35.166810 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7644ba01-a90e-4b26-8869-00fac582b2cf tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:35.167565 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7644ba01-a90e-4b26-8869-00fac582b2cf tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:35.168621 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7644ba01-a90e-4b26-8869-00fac582b2cf tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:35.169329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7644ba01-a90e-4b26-8869-00fac582b2cf tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:35.337319 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7644ba01-a90e-4b26-8869-00fac582b2cf tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:35.346164 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-7644ba01-a90e-4b26-8869-00fac582b2cf tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.192004 May 10 16:45:35.347025 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 52/98] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:35 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:35.572685 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9277b721-8901-4894-988e-723cf2c68e14 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:35.573295 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9277b721-8901-4894-988e-723cf2c68e14 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:35.579025 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9277b721-8901-4894-988e-723cf2c68e14 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:35.579484 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9277b721-8901-4894-988e-723cf2c68e14 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:35.580249 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9277b721-8901-4894-988e-723cf2c68e14 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:35.580682 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9277b721-8901-4894-988e-723cf2c68e14 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:35.706434 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9277b721-8901-4894-988e-723cf2c68e14 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:35.714423 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9277b721-8901-4894-988e-723cf2c68e14 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:35.716205 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9277b721-8901-4894-988e-723cf2c68e14 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:35.717405 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9277b721-8901-4894-988e-723cf2c68e14 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.148585 May 10 16:45:35.717959 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 47/99] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:35 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:36.024037 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-6c5ea6df-0861-4657-94ff-8ca36da3c3f1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:36.024657 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-6c5ea6df-0861-4657-94ff-8ca36da3c3f1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:36.030511 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6c5ea6df-0861-4657-94ff-8ca36da3c3f1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:36.032641 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6c5ea6df-0861-4657-94ff-8ca36da3c3f1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:36.033443 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6c5ea6df-0861-4657-94ff-8ca36da3c3f1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:36.033879 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6c5ea6df-0861-4657-94ff-8ca36da3c3f1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:36.171913 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6c5ea6df-0861-4657-94ff-8ca36da3c3f1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:36.179763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-6c5ea6df-0861-4657-94ff-8ca36da3c3f1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.160143 May 10 16:45:36.180412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 53/100] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:36 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:36.363089 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-70b67cf9-1bd2-46be-b29b-7b23465f0b8c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:36.363707 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-70b67cf9-1bd2-46be-b29b-7b23465f0b8c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:36.369450 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-70b67cf9-1bd2-46be-b29b-7b23465f0b8c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:36.369899 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-70b67cf9-1bd2-46be-b29b-7b23465f0b8c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:36.370675 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-70b67cf9-1bd2-46be-b29b-7b23465f0b8c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:36.371149 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-70b67cf9-1bd2-46be-b29b-7b23465f0b8c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:36.504593 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-70b67cf9-1bd2-46be-b29b-7b23465f0b8c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:36.512010 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-70b67cf9-1bd2-46be-b29b-7b23465f0b8c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.152870 May 10 16:45:36.512669 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 48/101] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:36 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:36.735424 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-e692e60b-9c4c-453e-9a32-2d9317fc18dd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:36.736062 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-e692e60b-9c4c-453e-9a32-2d9317fc18dd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:36.742038 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e692e60b-9c4c-453e-9a32-2d9317fc18dd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:36.742492 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e692e60b-9c4c-453e-9a32-2d9317fc18dd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:36.743306 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e692e60b-9c4c-453e-9a32-2d9317fc18dd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:36.743765 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e692e60b-9c4c-453e-9a32-2d9317fc18dd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:36.876325 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-e692e60b-9c4c-453e-9a32-2d9317fc18dd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:36.885554 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-e692e60b-9c4c-453e-9a32-2d9317fc18dd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:36.886973 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-e692e60b-9c4c-453e-9a32-2d9317fc18dd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:36.888124 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-e692e60b-9c4c-453e-9a32-2d9317fc18dd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.157045 May 10 16:45:36.888692 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 54/102] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:36 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:37.198212 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b8a4022f-8447-446e-90b2-f8616e2ce715 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:37.199090 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b8a4022f-8447-446e-90b2-f8616e2ce715 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:37.205790 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b8a4022f-8447-446e-90b2-f8616e2ce715 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:37.206244 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b8a4022f-8447-446e-90b2-f8616e2ce715 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:37.207038 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b8a4022f-8447-446e-90b2-f8616e2ce715 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:37.208095 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b8a4022f-8447-446e-90b2-f8616e2ce715 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:37.342407 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b8a4022f-8447-446e-90b2-f8616e2ce715 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:37.349974 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b8a4022f-8447-446e-90b2-f8616e2ce715 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.156573 May 10 16:45:37.350542 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 49/103] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:37 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:37.529303 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-9fb035c3-7a99-44eb-86c1-73411b76fc04 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:37.529941 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-9fb035c3-7a99-44eb-86c1-73411b76fc04 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:37.536455 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9fb035c3-7a99-44eb-86c1-73411b76fc04 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:37.536907 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9fb035c3-7a99-44eb-86c1-73411b76fc04 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:37.537666 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9fb035c3-7a99-44eb-86c1-73411b76fc04 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:37.538099 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9fb035c3-7a99-44eb-86c1-73411b76fc04 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:37.660955 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-9fb035c3-7a99-44eb-86c1-73411b76fc04 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:37.668627 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-9fb035c3-7a99-44eb-86c1-73411b76fc04 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.143235 May 10 16:45:37.669193 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 55/104] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:37 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:37.905542 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7095e201-709d-498c-8ade-9c0417419738 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:37.906147 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7095e201-709d-498c-8ade-9c0417419738 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:37.912019 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7095e201-709d-498c-8ade-9c0417419738 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:37.912460 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7095e201-709d-498c-8ade-9c0417419738 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:37.913211 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7095e201-709d-498c-8ade-9c0417419738 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:37.913646 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7095e201-709d-498c-8ade-9c0417419738 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:38.042617 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7095e201-709d-498c-8ade-9c0417419738 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:38.050633 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7095e201-709d-498c-8ade-9c0417419738 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:38.052165 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7095e201-709d-498c-8ade-9c0417419738 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:38.053244 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7095e201-709d-498c-8ade-9c0417419738 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.151608 May 10 16:45:38.053790 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 50/105] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:37 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:38.367352 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-ef7852d8-25e5-4cc5-a451-a92dd725c85d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:38.367953 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-ef7852d8-25e5-4cc5-a451-a92dd725c85d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:38.373785 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ef7852d8-25e5-4cc5-a451-a92dd725c85d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:38.374253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ef7852d8-25e5-4cc5-a451-a92dd725c85d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:38.375654 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ef7852d8-25e5-4cc5-a451-a92dd725c85d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:38.376081 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ef7852d8-25e5-4cc5-a451-a92dd725c85d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:38.500444 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ef7852d8-25e5-4cc5-a451-a92dd725c85d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:38.507720 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-ef7852d8-25e5-4cc5-a451-a92dd725c85d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.144111 May 10 16:45:38.508282 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 56/106] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:38 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:38.685813 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1ecf8d63-4a27-472c-9c62-12f646dc4d60 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:38.686356 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1ecf8d63-4a27-472c-9c62-12f646dc4d60 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:38.692110 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1ecf8d63-4a27-472c-9c62-12f646dc4d60 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:38.692558 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1ecf8d63-4a27-472c-9c62-12f646dc4d60 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:38.693329 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1ecf8d63-4a27-472c-9c62-12f646dc4d60 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:38.693768 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1ecf8d63-4a27-472c-9c62-12f646dc4d60 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:38.813667 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-9a8fb7bb-5e89-4e54-a331-81bbe28423c0 req-a56e1640-9804-46ee-9142-14046263d774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7072f21c-b362-4442-9b4e-e7ad82c6ab7d", "name": "network-vif-plugged", "status": "completed", "tag": "6c9ff718-8934-43ae-8084-2ab8d87294af"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:45:38.823866 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1ecf8d63-4a27-472c-9c62-12f646dc4d60 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:38.824682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-9a8fb7bb-5e89-4e54-a331-81bbe28423c0 req-a56e1640-9804-46ee-9142-14046263d774 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:38.825305 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-9a8fb7bb-5e89-4e54-a331-81bbe28423c0 req-a56e1640-9804-46ee-9142-14046263d774 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:38.832489 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1ecf8d63-4a27-472c-9c62-12f646dc4d60 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.150604 May 10 16:45:38.842022 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 51/107] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:38 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:38.845462 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-9a8fb7bb-5e89-4e54-a331-81bbe28423c0 req-a56e1640-9804-46ee-9142-14046263d774 service nova] Creating event network-vif-plugged:6c9ff718-8934-43ae-8084-2ab8d87294af for instance 7072f21c-b362-4442-9b4e-e7ad82c6ab7d on hv-cinder-84130 May 10 16:45:38.850781 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-9a8fb7bb-5e89-4e54-a331-81bbe28423c0 req-a56e1640-9804-46ee-9142-14046263d774 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041113 May 10 16:45:38.851411 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 57/108] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:45:39.071795 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c468ddc7-3ce3-44c4-9447-4667d175b40b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:39.072402 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c468ddc7-3ce3-44c4-9447-4667d175b40b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:39.079261 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c468ddc7-3ce3-44c4-9447-4667d175b40b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:39.079712 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c468ddc7-3ce3-44c4-9447-4667d175b40b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:39.080470 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c468ddc7-3ce3-44c4-9447-4667d175b40b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:39.080899 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c468ddc7-3ce3-44c4-9447-4667d175b40b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:39.207020 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c468ddc7-3ce3-44c4-9447-4667d175b40b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:39.215218 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c468ddc7-3ce3-44c4-9447-4667d175b40b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:39.216718 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c468ddc7-3ce3-44c4-9447-4667d175b40b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:39.217875 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c468ddc7-3ce3-44c4-9447-4667d175b40b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.150232 May 10 16:45:39.219033 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 52/109] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:39 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:39.524552 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-5b1e2d83-a413-4cc5-8c1a-c12ed739b08f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:39.529313 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-5b1e2d83-a413-4cc5-8c1a-c12ed739b08f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:39.535487 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5b1e2d83-a413-4cc5-8c1a-c12ed739b08f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:39.535929 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5b1e2d83-a413-4cc5-8c1a-c12ed739b08f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:39.536690 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5b1e2d83-a413-4cc5-8c1a-c12ed739b08f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:39.537117 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5b1e2d83-a413-4cc5-8c1a-c12ed739b08f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:39.674456 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-5b1e2d83-a413-4cc5-8c1a-c12ed739b08f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:39.682076 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-5b1e2d83-a413-4cc5-8c1a-c12ed739b08f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.161640 May 10 16:45:39.682647 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 58/110] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:39 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:39.849514 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1b85011d-829e-4063-b2b5-d128dbeffb2c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:39.850207 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1b85011d-829e-4063-b2b5-d128dbeffb2c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:39.855989 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b85011d-829e-4063-b2b5-d128dbeffb2c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:39.856442 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b85011d-829e-4063-b2b5-d128dbeffb2c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:39.857214 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b85011d-829e-4063-b2b5-d128dbeffb2c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:39.857650 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b85011d-829e-4063-b2b5-d128dbeffb2c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:40.037895 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1b85011d-829e-4063-b2b5-d128dbeffb2c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:40.045226 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1b85011d-829e-4063-b2b5-d128dbeffb2c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.199571 May 10 16:45:40.045794 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 53/111] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:39 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:40.236122 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-4851d73a-3e0a-46fc-9ccb-85e26ba8ede0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:40.237141 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-4851d73a-3e0a-46fc-9ccb-85e26ba8ede0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:40.245474 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4851d73a-3e0a-46fc-9ccb-85e26ba8ede0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:40.246325 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4851d73a-3e0a-46fc-9ccb-85e26ba8ede0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:40.247159 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4851d73a-3e0a-46fc-9ccb-85e26ba8ede0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:40.247604 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4851d73a-3e0a-46fc-9ccb-85e26ba8ede0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:40.385509 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-4851d73a-3e0a-46fc-9ccb-85e26ba8ede0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:40.393865 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-4851d73a-3e0a-46fc-9ccb-85e26ba8ede0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:40.395486 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-4851d73a-3e0a-46fc-9ccb-85e26ba8ede0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:40.396592 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-4851d73a-3e0a-46fc-9ccb-85e26ba8ede0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.165020 May 10 16:45:40.397148 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 59/112] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:40 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:40.700520 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-11c85792-6c3e-4343-a036-9ad9ddf0c565 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:40.701203 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-11c85792-6c3e-4343-a036-9ad9ddf0c565 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:40.707995 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-11c85792-6c3e-4343-a036-9ad9ddf0c565 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:40.708515 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-11c85792-6c3e-4343-a036-9ad9ddf0c565 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:40.709614 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-11c85792-6c3e-4343-a036-9ad9ddf0c565 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:40.710118 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-11c85792-6c3e-4343-a036-9ad9ddf0c565 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:40.842923 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-11c85792-6c3e-4343-a036-9ad9ddf0c565 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:40.850544 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-11c85792-6c3e-4343-a036-9ad9ddf0c565 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.154378 May 10 16:45:40.851216 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 54/113] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:40 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:41.062615 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-67a9d697-2b1c-4100-be1c-3dce6308fa2b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:41.063279 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-67a9d697-2b1c-4100-be1c-3dce6308fa2b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:41.069602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-67a9d697-2b1c-4100-be1c-3dce6308fa2b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:41.070065 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-67a9d697-2b1c-4100-be1c-3dce6308fa2b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:41.070897 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-67a9d697-2b1c-4100-be1c-3dce6308fa2b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:41.071404 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-67a9d697-2b1c-4100-be1c-3dce6308fa2b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:41.204173 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-67a9d697-2b1c-4100-be1c-3dce6308fa2b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:41.211529 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-67a9d697-2b1c-4100-be1c-3dce6308fa2b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.153292 May 10 16:45:41.212101 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 60/114] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:41 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:41.414699 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c2e7ae99-5372-4ed9-a8c4-7ce516db6286 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:41.415340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c2e7ae99-5372-4ed9-a8c4-7ce516db6286 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:41.421080 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c2e7ae99-5372-4ed9-a8c4-7ce516db6286 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:41.422034 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c2e7ae99-5372-4ed9-a8c4-7ce516db6286 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:41.422801 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c2e7ae99-5372-4ed9-a8c4-7ce516db6286 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:41.423258 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c2e7ae99-5372-4ed9-a8c4-7ce516db6286 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:41.554460 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c2e7ae99-5372-4ed9-a8c4-7ce516db6286 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:41.562380 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c2e7ae99-5372-4ed9-a8c4-7ce516db6286 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:41.563929 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c2e7ae99-5372-4ed9-a8c4-7ce516db6286 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:41.565042 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c2e7ae99-5372-4ed9-a8c4-7ce516db6286 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.154171 May 10 16:45:41.565643 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 55/115] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:41 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:41.870211 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-31cc5274-d855-47e3-882b-12a7fbe600cc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:41.870753 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-31cc5274-d855-47e3-882b-12a7fbe600cc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:41.877344 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-31cc5274-d855-47e3-882b-12a7fbe600cc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:41.878002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-31cc5274-d855-47e3-882b-12a7fbe600cc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:41.878925 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-31cc5274-d855-47e3-882b-12a7fbe600cc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:41.879551 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-31cc5274-d855-47e3-882b-12a7fbe600cc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:42.019799 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-31cc5274-d855-47e3-882b-12a7fbe600cc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:42.027648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-31cc5274-d855-47e3-882b-12a7fbe600cc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.161650 May 10 16:45:42.028229 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 61/116] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:41 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:45:42.228460 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c0a8cf64-6175-497a-bfaa-30bf40a5c063 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:42.229093 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c0a8cf64-6175-497a-bfaa-30bf40a5c063 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:42.244198 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0a8cf64-6175-497a-bfaa-30bf40a5c063 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:42.244878 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0a8cf64-6175-497a-bfaa-30bf40a5c063 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:42.245960 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0a8cf64-6175-497a-bfaa-30bf40a5c063 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:42.246760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c0a8cf64-6175-497a-bfaa-30bf40a5c063 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:42.514761 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c0a8cf64-6175-497a-bfaa-30bf40a5c063 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:42.522062 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c0a8cf64-6175-497a-bfaa-30bf40a5c063 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.297503 May 10 16:45:42.522802 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 56/117] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:42 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:42.583496 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-772daaf5-d764-490a-b6b8-f7e5240c72e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:42.584134 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-772daaf5-d764-490a-b6b8-f7e5240c72e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:42.590076 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-772daaf5-d764-490a-b6b8-f7e5240c72e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:42.590522 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-772daaf5-d764-490a-b6b8-f7e5240c72e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:42.591550 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-772daaf5-d764-490a-b6b8-f7e5240c72e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:42.592028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-772daaf5-d764-490a-b6b8-f7e5240c72e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:42.757898 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-772daaf5-d764-490a-b6b8-f7e5240c72e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:42.767272 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-772daaf5-d764-490a-b6b8-f7e5240c72e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:42.769162 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-772daaf5-d764-490a-b6b8-f7e5240c72e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:42.770500 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-772daaf5-d764-490a-b6b8-f7e5240c72e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.191527 May 10 16:45:42.771615 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 62/118] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:42 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:45:43.053031 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6a9a6336-a908-42de-ab32-abfcfbbaf169 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:43.054440 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6a9a6336-a908-42de-ab32-abfcfbbaf169 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:43.066510 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a9a6336-a908-42de-ab32-abfcfbbaf169 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:43.066955 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a9a6336-a908-42de-ab32-abfcfbbaf169 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:43.068367 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a9a6336-a908-42de-ab32-abfcfbbaf169 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:43.068959 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6a9a6336-a908-42de-ab32-abfcfbbaf169 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:43.235066 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6a9a6336-a908-42de-ab32-abfcfbbaf169 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:43.243690 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6a9a6336-a908-42de-ab32-abfcfbbaf169 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.202676 May 10 16:45:43.247155 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 57/119] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:43 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:43.323062 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-c8d4b68e-2d11-48df-8d38-78e41e5740b8 req-ce4ed149-8c5b-45b5-9af9-8a1eb744d522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21", "name": "network-vif-plugged", "status": "completed", "tag": "c50b1483-8b5c-448b-bff0-552cf91cad7e"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:45:43.332769 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-c8d4b68e-2d11-48df-8d38-78e41e5740b8 req-ce4ed149-8c5b-45b5-9af9-8a1eb744d522 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:43.333298 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-c8d4b68e-2d11-48df-8d38-78e41e5740b8 req-ce4ed149-8c5b-45b5-9af9-8a1eb744d522 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:43.346546 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-c8d4b68e-2d11-48df-8d38-78e41e5740b8 req-ce4ed149-8c5b-45b5-9af9-8a1eb744d522 service nova] Creating event network-vif-plugged:c50b1483-8b5c-448b-bff0-552cf91cad7e for instance e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 on hv-cinder-84130 May 10 16:45:43.353501 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-c8d4b68e-2d11-48df-8d38-78e41e5740b8 req-ce4ed149-8c5b-45b5-9af9-8a1eb744d522 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034009 May 10 16:45:43.354137 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 63/120] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:43.539891 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b046b8f4-044e-406b-a3f2-e7e3f5796584 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:43.541003 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b046b8f4-044e-406b-a3f2-e7e3f5796584 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:43.548202 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b046b8f4-044e-406b-a3f2-e7e3f5796584 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:43.551937 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b046b8f4-044e-406b-a3f2-e7e3f5796584 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:43.554401 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b046b8f4-044e-406b-a3f2-e7e3f5796584 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:43.554935 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b046b8f4-044e-406b-a3f2-e7e3f5796584 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:43.678109 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b046b8f4-044e-406b-a3f2-e7e3f5796584 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:43.685280 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b046b8f4-044e-406b-a3f2-e7e3f5796584 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.149193 May 10 16:45:43.685853 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 58/121] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:43 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:43.789334 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-5a149558-1946-4d28-8c0f-f2514b4e05a3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:43.790158 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-5a149558-1946-4d28-8c0f-f2514b4e05a3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:43.796236 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5a149558-1946-4d28-8c0f-f2514b4e05a3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:43.796769 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5a149558-1946-4d28-8c0f-f2514b4e05a3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:43.797551 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5a149558-1946-4d28-8c0f-f2514b4e05a3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:43.797989 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5a149558-1946-4d28-8c0f-f2514b4e05a3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:43.941900 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-5a149558-1946-4d28-8c0f-f2514b4e05a3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:43.949770 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-5a149558-1946-4d28-8c0f-f2514b4e05a3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:43.951345 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-5a149558-1946-4d28-8c0f-f2514b4e05a3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:43.953119 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-5a149558-1946-4d28-8c0f-f2514b4e05a3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.167491 May 10 16:45:43.953673 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 64/122] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:43 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:44.264492 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2f67581b-73f6-4864-84b2-112e7aad8528 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:44.265317 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2f67581b-73f6-4864-84b2-112e7aad8528 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:44.272704 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2f67581b-73f6-4864-84b2-112e7aad8528 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:44.273157 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2f67581b-73f6-4864-84b2-112e7aad8528 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:44.273932 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2f67581b-73f6-4864-84b2-112e7aad8528 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:44.274366 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2f67581b-73f6-4864-84b2-112e7aad8528 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:44.405620 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2f67581b-73f6-4864-84b2-112e7aad8528 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:44.412803 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2f67581b-73f6-4864-84b2-112e7aad8528 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.155015 May 10 16:45:44.413376 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 59/123] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:44 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:44.701983 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f6bbf603-ae90-4cd8-b6ca-1f7f5bbf9ee2 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:44.702584 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-f6bbf603-ae90-4cd8-b6ca-1f7f5bbf9ee2 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:44.708354 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f6bbf603-ae90-4cd8-b6ca-1f7f5bbf9ee2 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:44.708799 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f6bbf603-ae90-4cd8-b6ca-1f7f5bbf9ee2 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:44.709546 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f6bbf603-ae90-4cd8-b6ca-1f7f5bbf9ee2 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:44.709973 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f6bbf603-ae90-4cd8-b6ca-1f7f5bbf9ee2 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:44.839504 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f6bbf603-ae90-4cd8-b6ca-1f7f5bbf9ee2 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:44.847067 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-f6bbf603-ae90-4cd8-b6ca-1f7f5bbf9ee2 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.148859 May 10 16:45:44.847626 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 65/124] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:44 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:44.970652 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ad60e322-a254-4ade-afa7-0ed7e8a93378 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:44.971298 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ad60e322-a254-4ade-afa7-0ed7e8a93378 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:44.977730 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ad60e322-a254-4ade-afa7-0ed7e8a93378 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:44.978172 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ad60e322-a254-4ade-afa7-0ed7e8a93378 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:44.978929 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ad60e322-a254-4ade-afa7-0ed7e8a93378 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:44.979394 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ad60e322-a254-4ade-afa7-0ed7e8a93378 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:45.105695 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ad60e322-a254-4ade-afa7-0ed7e8a93378 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:45.113400 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ad60e322-a254-4ade-afa7-0ed7e8a93378 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:45.114894 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ad60e322-a254-4ade-afa7-0ed7e8a93378 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:45.116015 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ad60e322-a254-4ade-afa7-0ed7e8a93378 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.149193 May 10 16:45:45.116561 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 60/125] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:44 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:45.429824 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-40909587-971d-48dc-9ffe-7d06743df2e1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:45.430434 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-40909587-971d-48dc-9ffe-7d06743df2e1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:45.436212 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-40909587-971d-48dc-9ffe-7d06743df2e1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:45.436662 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-40909587-971d-48dc-9ffe-7d06743df2e1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:45.437923 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-40909587-971d-48dc-9ffe-7d06743df2e1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:45.438356 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-40909587-971d-48dc-9ffe-7d06743df2e1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:45.563678 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-40909587-971d-48dc-9ffe-7d06743df2e1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:45.570784 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-40909587-971d-48dc-9ffe-7d06743df2e1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.144726 May 10 16:45:45.571390 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 66/126] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:45 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:45.864267 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-81342b06-08f5-4bfc-80f2-927ece258439 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:45.864876 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-81342b06-08f5-4bfc-80f2-927ece258439 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:45.870729 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-81342b06-08f5-4bfc-80f2-927ece258439 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:45.871222 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-81342b06-08f5-4bfc-80f2-927ece258439 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:45.871985 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-81342b06-08f5-4bfc-80f2-927ece258439 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:45.872427 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-81342b06-08f5-4bfc-80f2-927ece258439 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:46.007586 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-81342b06-08f5-4bfc-80f2-927ece258439 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:46.015415 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-81342b06-08f5-4bfc-80f2-927ece258439 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.154834 May 10 16:45:46.016011 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 61/127] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:45 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:46.133330 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-eb6c3120-3e11-43e7-8f38-2c6944058db9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:46.133930 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-eb6c3120-3e11-43e7-8f38-2c6944058db9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:46.139997 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-eb6c3120-3e11-43e7-8f38-2c6944058db9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:46.140431 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-eb6c3120-3e11-43e7-8f38-2c6944058db9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:46.141183 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-eb6c3120-3e11-43e7-8f38-2c6944058db9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:46.141613 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-eb6c3120-3e11-43e7-8f38-2c6944058db9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:46.265798 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-eb6c3120-3e11-43e7-8f38-2c6944058db9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:46.273460 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-eb6c3120-3e11-43e7-8f38-2c6944058db9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:46.274944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-eb6c3120-3e11-43e7-8f38-2c6944058db9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:46.276061 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-eb6c3120-3e11-43e7-8f38-2c6944058db9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.146482 May 10 16:45:46.276620 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 67/128] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:46 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:45:46.587903 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-65be1dc6-1180-4fe7-bdc0-8e53f3d5612c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:46.588501 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-65be1dc6-1180-4fe7-bdc0-8e53f3d5612c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:46.595913 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-65be1dc6-1180-4fe7-bdc0-8e53f3d5612c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:46.596367 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-65be1dc6-1180-4fe7-bdc0-8e53f3d5612c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:46.597146 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-65be1dc6-1180-4fe7-bdc0-8e53f3d5612c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:46.597588 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-65be1dc6-1180-4fe7-bdc0-8e53f3d5612c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:46.750161 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-65be1dc6-1180-4fe7-bdc0-8e53f3d5612c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:46.757662 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-65be1dc6-1180-4fe7-bdc0-8e53f3d5612c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.173681 May 10 16:45:46.758528 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 62/129] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:46 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:47.031889 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-ee778c2f-7ce5-4023-a1a4-56da82afbef7 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:47.032491 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-ee778c2f-7ce5-4023-a1a4-56da82afbef7 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:47.038381 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ee778c2f-7ce5-4023-a1a4-56da82afbef7 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:47.038851 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ee778c2f-7ce5-4023-a1a4-56da82afbef7 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:47.039647 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ee778c2f-7ce5-4023-a1a4-56da82afbef7 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:47.040078 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ee778c2f-7ce5-4023-a1a4-56da82afbef7 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:47.163838 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ee778c2f-7ce5-4023-a1a4-56da82afbef7 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:47.170847 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-ee778c2f-7ce5-4023-a1a4-56da82afbef7 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.143269 May 10 16:45:47.171463 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 68/130] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:47 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:47.293975 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ee6b6fe9-af72-45ed-8222-d02400fac7e7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:47.294607 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ee6b6fe9-af72-45ed-8222-d02400fac7e7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:47.300749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ee6b6fe9-af72-45ed-8222-d02400fac7e7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:47.302175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ee6b6fe9-af72-45ed-8222-d02400fac7e7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:47.302175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ee6b6fe9-af72-45ed-8222-d02400fac7e7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:47.302397 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ee6b6fe9-af72-45ed-8222-d02400fac7e7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:47.432599 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ee6b6fe9-af72-45ed-8222-d02400fac7e7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:47.440842 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ee6b6fe9-af72-45ed-8222-d02400fac7e7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:47.442368 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ee6b6fe9-af72-45ed-8222-d02400fac7e7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:47.443490 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ee6b6fe9-af72-45ed-8222-d02400fac7e7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.153343 May 10 16:45:47.444029 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 63/131] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:47 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:47.774702 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-280d2498-329e-48e6-aac0-f2692195aaa8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:47.775333 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-280d2498-329e-48e6-aac0-f2692195aaa8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:47.781286 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-280d2498-329e-48e6-aac0-f2692195aaa8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:47.781735 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-280d2498-329e-48e6-aac0-f2692195aaa8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:47.782660 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-280d2498-329e-48e6-aac0-f2692195aaa8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:47.783277 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-280d2498-329e-48e6-aac0-f2692195aaa8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:47.913117 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-280d2498-329e-48e6-aac0-f2692195aaa8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:47.920246 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-280d2498-329e-48e6-aac0-f2692195aaa8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.149285 May 10 16:45:47.920805 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 69/132] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:47 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:48.188061 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-21ee735f-c8d9-4af1-bdf8-8f4f21673ac4 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:48.188769 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-21ee735f-c8d9-4af1-bdf8-8f4f21673ac4 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:48.194467 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-21ee735f-c8d9-4af1-bdf8-8f4f21673ac4 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:48.194910 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-21ee735f-c8d9-4af1-bdf8-8f4f21673ac4 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:48.195702 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-21ee735f-c8d9-4af1-bdf8-8f4f21673ac4 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:48.196134 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-21ee735f-c8d9-4af1-bdf8-8f4f21673ac4 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:48.319533 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-21ee735f-c8d9-4af1-bdf8-8f4f21673ac4 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:48.326638 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-21ee735f-c8d9-4af1-bdf8-8f4f21673ac4 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.142905 May 10 16:45:48.327246 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 64/133] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:48 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:48.461297 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-6fefbc77-9920-4470-acea-024a9111f8d3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:48.461828 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-6fefbc77-9920-4470-acea-024a9111f8d3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:48.467582 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6fefbc77-9920-4470-acea-024a9111f8d3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:48.468517 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6fefbc77-9920-4470-acea-024a9111f8d3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:48.469296 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6fefbc77-9920-4470-acea-024a9111f8d3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:48.469726 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6fefbc77-9920-4470-acea-024a9111f8d3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:48.596904 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6fefbc77-9920-4470-acea-024a9111f8d3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:48.604585 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6fefbc77-9920-4470-acea-024a9111f8d3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:48.606073 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6fefbc77-9920-4470-acea-024a9111f8d3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:48.607197 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-6fefbc77-9920-4470-acea-024a9111f8d3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.149737 May 10 16:45:48.607756 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 70/134] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:48 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:48.937966 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-95bc4f4e-79f5-469f-b9cc-b814db117816 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:48.938575 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-95bc4f4e-79f5-469f-b9cc-b814db117816 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:48.944406 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-95bc4f4e-79f5-469f-b9cc-b814db117816 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:48.944860 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-95bc4f4e-79f5-469f-b9cc-b814db117816 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:48.945616 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-95bc4f4e-79f5-469f-b9cc-b814db117816 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:48.946051 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-95bc4f4e-79f5-469f-b9cc-b814db117816 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:49.073009 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-95bc4f4e-79f5-469f-b9cc-b814db117816 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:49.080408 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-95bc4f4e-79f5-469f-b9cc-b814db117816 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.146858 May 10 16:45:49.081004 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 65/135] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:48 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:49.342459 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-97680ebc-8b58-4c48-8990-e756b74e30df tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:49.343580 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-97680ebc-8b58-4c48-8990-e756b74e30df tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:49.349381 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-97680ebc-8b58-4c48-8990-e756b74e30df tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:49.349821 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-97680ebc-8b58-4c48-8990-e756b74e30df tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:49.350575 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-97680ebc-8b58-4c48-8990-e756b74e30df tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:49.351024 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-97680ebc-8b58-4c48-8990-e756b74e30df tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:49.477527 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-97680ebc-8b58-4c48-8990-e756b74e30df tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:49.484844 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-97680ebc-8b58-4c48-8990-e756b74e30df tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1315 microversion: 2.1 time: 0.145999 May 10 16:45:49.485438 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 71/136] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:49 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:49.625755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-95ca8557-2f18-4c4b-b6f0-1df4d3cd9d77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:49.626358 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-95ca8557-2f18-4c4b-b6f0-1df4d3cd9d77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:49.632452 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-95ca8557-2f18-4c4b-b6f0-1df4d3cd9d77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:49.632933 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-95ca8557-2f18-4c4b-b6f0-1df4d3cd9d77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:49.633796 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-95ca8557-2f18-4c4b-b6f0-1df4d3cd9d77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:49.634509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-95ca8557-2f18-4c4b-b6f0-1df4d3cd9d77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:49.791575 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-95ca8557-2f18-4c4b-b6f0-1df4d3cd9d77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:49.799611 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-95ca8557-2f18-4c4b-b6f0-1df4d3cd9d77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:49.801389 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-95ca8557-2f18-4c4b-b6f0-1df4d3cd9d77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:49.802513 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-95ca8557-2f18-4c4b-b6f0-1df4d3cd9d77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.180869 May 10 16:45:49.805399 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 66/137] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:49 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:49.972553 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-41132dc6-9b72-4008-a0af-dc5accda0dc7 req-9a22400c-232a-4c6f-8de1-d0b74c58de89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a49eb5-dff1-452f-9e73-a8a9b0c64649", "name": "network-vif-plugged", "status": "completed", "tag": "0e22ce60-edf0-4181-80b7-08f1d62c396b"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:45:49.986225 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-41132dc6-9b72-4008-a0af-dc5accda0dc7 req-9a22400c-232a-4c6f-8de1-d0b74c58de89 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:49.986225 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-41132dc6-9b72-4008-a0af-dc5accda0dc7 req-9a22400c-232a-4c6f-8de1-d0b74c58de89 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:49.995373 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-41132dc6-9b72-4008-a0af-dc5accda0dc7 req-9a22400c-232a-4c6f-8de1-d0b74c58de89 service nova] Creating event network-vif-plugged:0e22ce60-edf0-4181-80b7-08f1d62c396b for instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 on hv-cinder-84130 May 10 16:45:50.000905 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-41132dc6-9b72-4008-a0af-dc5accda0dc7 req-9a22400c-232a-4c6f-8de1-d0b74c58de89 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032668 May 10 16:45:50.001690 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 72/138] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:45:50.096928 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4a20ff88-6c3a-42b0-9ee6-85505d4caa1b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:50.097536 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4a20ff88-6c3a-42b0-9ee6-85505d4caa1b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:50.103304 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4a20ff88-6c3a-42b0-9ee6-85505d4caa1b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:50.103754 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4a20ff88-6c3a-42b0-9ee6-85505d4caa1b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:50.104510 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4a20ff88-6c3a-42b0-9ee6-85505d4caa1b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:50.104948 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4a20ff88-6c3a-42b0-9ee6-85505d4caa1b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:50.414784 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4a20ff88-6c3a-42b0-9ee6-85505d4caa1b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:50.419736 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4a20ff88-6c3a-42b0-9ee6-85505d4caa1b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.326674 May 10 16:45:50.420699 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 67/139] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:50 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:50.502739 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-6479e327-5f91-46b9-8a93-cec84ecea16b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:50.503470 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-6479e327-5f91-46b9-8a93-cec84ecea16b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:50.510249 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6479e327-5f91-46b9-8a93-cec84ecea16b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:50.510982 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6479e327-5f91-46b9-8a93-cec84ecea16b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:50.511828 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6479e327-5f91-46b9-8a93-cec84ecea16b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:50.512268 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6479e327-5f91-46b9-8a93-cec84ecea16b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:50.657519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6479e327-5f91-46b9-8a93-cec84ecea16b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:50.668148 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-6479e327-5f91-46b9-8a93-cec84ecea16b tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1502 microversion: 2.1 time: 0.169952 May 10 16:45:50.668736 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 73/140] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:50 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:50.820535 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f9ce99b3-61f5-4635-9fa2-25d8a07c8718 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:50.821741 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f9ce99b3-61f5-4635-9fa2-25d8a07c8718 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:50.829509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f9ce99b3-61f5-4635-9fa2-25d8a07c8718 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:50.830267 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f9ce99b3-61f5-4635-9fa2-25d8a07c8718 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:50.831665 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f9ce99b3-61f5-4635-9fa2-25d8a07c8718 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:50.832167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f9ce99b3-61f5-4635-9fa2-25d8a07c8718 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:50.983271 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f9ce99b3-61f5-4635-9fa2-25d8a07c8718 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:50.993811 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f9ce99b3-61f5-4635-9fa2-25d8a07c8718 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:50.996028 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f9ce99b3-61f5-4635-9fa2-25d8a07c8718 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:51.001775 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f9ce99b3-61f5-4635-9fa2-25d8a07c8718 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.181057 May 10 16:45:51.002637 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 68/141] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:50 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:51.439685 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-969d7e0d-ffc1-40dc-85d3-e784000882db tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:51.440393 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-969d7e0d-ffc1-40dc-85d3-e784000882db tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:51.459940 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-969d7e0d-ffc1-40dc-85d3-e784000882db tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:51.460518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-969d7e0d-ffc1-40dc-85d3-e784000882db tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:51.461604 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-969d7e0d-ffc1-40dc-85d3-e784000882db tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:51.462039 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-969d7e0d-ffc1-40dc-85d3-e784000882db tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:51.632810 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-969d7e0d-ffc1-40dc-85d3-e784000882db tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:51.645897 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-969d7e0d-ffc1-40dc-85d3-e784000882db tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.207123 May 10 16:45:51.646743 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 74/142] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:51 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:52.020907 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-96beb74c-90f6-49ab-aabc-98896ea4201b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:52.021518 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-96beb74c-90f6-49ab-aabc-98896ea4201b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:52.028451 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-96beb74c-90f6-49ab-aabc-98896ea4201b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:52.028981 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-96beb74c-90f6-49ab-aabc-98896ea4201b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:52.029948 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-96beb74c-90f6-49ab-aabc-98896ea4201b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:52.030880 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-96beb74c-90f6-49ab-aabc-98896ea4201b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:52.166774 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-56d0b0c2-16e6-4b3f-a83a-e1b4a6e0d5ab tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de303343-5aac-456a-99b0-dd8ae5ac2b8d"}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:45:52.168500 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-56d0b0c2-16e6-4b3f-a83a-e1b4a6e0d5ab tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:52.170863 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-96beb74c-90f6-49ab-aabc-98896ea4201b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:52.175005 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-56d0b0c2-16e6-4b3f-a83a-e1b4a6e0d5ab tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:52.175904 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-56d0b0c2-16e6-4b3f-a83a-e1b4a6e0d5ab tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:52.176684 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-56d0b0c2-16e6-4b3f-a83a-e1b4a6e0d5ab tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:52.177157 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-56d0b0c2-16e6-4b3f-a83a-e1b4a6e0d5ab tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:52.180244 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-96beb74c-90f6-49ab-aabc-98896ea4201b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:52.182004 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-96beb74c-90f6-49ab-aabc-98896ea4201b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:52.183133 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-96beb74c-90f6-49ab-aabc-98896ea4201b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.166328 May 10 16:45:52.183686 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 69/143] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:52 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:45:52.662699 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2127e651-3f3d-4d6e-a270-48ce80747af9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:52.663558 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2127e651-3f3d-4d6e-a270-48ce80747af9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:52.670381 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2127e651-3f3d-4d6e-a270-48ce80747af9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:52.670768 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2127e651-3f3d-4d6e-a270-48ce80747af9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:52.671813 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2127e651-3f3d-4d6e-a270-48ce80747af9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:52.672243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2127e651-3f3d-4d6e-a270-48ce80747af9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:52.828962 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2127e651-3f3d-4d6e-a270-48ce80747af9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:52.841147 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2127e651-3f3d-4d6e-a270-48ce80747af9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.182306 May 10 16:45:52.841982 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 70/144] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:52 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:53.202539 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fb09da24-d387-4d79-9d04-ce47481a4481 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:53.204725 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-fb09da24-d387-4d79-9d04-ce47481a4481 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:53.216841 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fb09da24-d387-4d79-9d04-ce47481a4481 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:53.216931 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fb09da24-d387-4d79-9d04-ce47481a4481 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:53.218030 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fb09da24-d387-4d79-9d04-ce47481a4481 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:53.225914 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fb09da24-d387-4d79-9d04-ce47481a4481 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:53.397733 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fb09da24-d387-4d79-9d04-ce47481a4481 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:53.406079 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fb09da24-d387-4d79-9d04-ce47481a4481 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:53.407607 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fb09da24-d387-4d79-9d04-ce47481a4481 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:53.408736 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fb09da24-d387-4d79-9d04-ce47481a4481 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.210462 May 10 16:45:53.409293 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 71/145] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:53 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:53.861229 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f102c9d6-2175-4423-9c46-d4784d4e47e5 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:53.862014 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f102c9d6-2175-4423-9c46-d4784d4e47e5 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:53.868348 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f102c9d6-2175-4423-9c46-d4784d4e47e5 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:53.868722 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f102c9d6-2175-4423-9c46-d4784d4e47e5 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:53.869544 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f102c9d6-2175-4423-9c46-d4784d4e47e5 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:53.869921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f102c9d6-2175-4423-9c46-d4784d4e47e5 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:54.016320 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f102c9d6-2175-4423-9c46-d4784d4e47e5 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:54.026072 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f102c9d6-2175-4423-9c46-d4784d4e47e5 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.172109 May 10 16:45:54.028120 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 72/146] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:53 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:45:54.430615 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f3c1c23e-c1c2-4633-919f-3bde6b57c8cd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:54.431488 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f3c1c23e-c1c2-4633-919f-3bde6b57c8cd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:54.437544 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f3c1c23e-c1c2-4633-919f-3bde6b57c8cd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:54.438003 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f3c1c23e-c1c2-4633-919f-3bde6b57c8cd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:54.438785 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f3c1c23e-c1c2-4633-919f-3bde6b57c8cd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:54.439253 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f3c1c23e-c1c2-4633-919f-3bde6b57c8cd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:54.584448 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f3c1c23e-c1c2-4633-919f-3bde6b57c8cd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:54.594496 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f3c1c23e-c1c2-4633-919f-3bde6b57c8cd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:54.596227 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f3c1c23e-c1c2-4633-919f-3bde6b57c8cd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:54.597391 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f3c1c23e-c1c2-4633-919f-3bde6b57c8cd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.173645 May 10 16:45:54.597945 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 73/147] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:54 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:45:55.045326 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-dc4e2095-ebe8-47d5-93d9-24a098d18aa9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:55.045985 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-dc4e2095-ebe8-47d5-93d9-24a098d18aa9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:55.063585 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc4e2095-ebe8-47d5-93d9-24a098d18aa9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:55.064253 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc4e2095-ebe8-47d5-93d9-24a098d18aa9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:55.065045 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc4e2095-ebe8-47d5-93d9-24a098d18aa9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:55.065645 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc4e2095-ebe8-47d5-93d9-24a098d18aa9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:55.266071 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-dc4e2095-ebe8-47d5-93d9-24a098d18aa9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:55.275078 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-dc4e2095-ebe8-47d5-93d9-24a098d18aa9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1322 microversion: 2.1 time: 0.234753 May 10 16:45:55.283768 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 74/148] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:55 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:45:55.615545 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d42a7a93-7e47-4484-b60b-c183025fc9d2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:55.616246 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d42a7a93-7e47-4484-b60b-c183025fc9d2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:55.622100 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d42a7a93-7e47-4484-b60b-c183025fc9d2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:55.622634 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d42a7a93-7e47-4484-b60b-c183025fc9d2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:55.623562 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d42a7a93-7e47-4484-b60b-c183025fc9d2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:55.624021 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d42a7a93-7e47-4484-b60b-c183025fc9d2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:55.783952 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d42a7a93-7e47-4484-b60b-c183025fc9d2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:55.792826 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d42a7a93-7e47-4484-b60b-c183025fc9d2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:55.794679 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d42a7a93-7e47-4484-b60b-c183025fc9d2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:55.796034 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d42a7a93-7e47-4484-b60b-c183025fc9d2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.184345 May 10 16:45:55.797462 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 75/149] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:55 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:45:56.293301 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-53e316de-3a4c-43cf-acb5-9d45658fac84 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:56.294091 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-53e316de-3a4c-43cf-acb5-9d45658fac84 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:56.306490 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-53e316de-3a4c-43cf-acb5-9d45658fac84 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:56.307177 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-53e316de-3a4c-43cf-acb5-9d45658fac84 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:56.308142 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-53e316de-3a4c-43cf-acb5-9d45658fac84 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:56.308636 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-53e316de-3a4c-43cf-acb5-9d45658fac84 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:56.386211 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-56d0b0c2-16e6-4b3f-a83a-e1b4a6e0d5ab tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "POST /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.206161 May 10 16:45:56.406375 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 75/150] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 16:45:52 2022] POST /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90/os-volume_attachments => generated 194 bytes in 4244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:45:56.504478 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-53e316de-3a4c-43cf-acb5-9d45658fac84 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:56.515716 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-53e316de-3a4c-43cf-acb5-9d45658fac84 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1517 microversion: 2.1 time: 0.225248 May 10 16:45:56.516309 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 76/151] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:56 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1517 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:56.535603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-03a54b58-e647-4a84-8c31-96e070c92f66 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:45:56.537279 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-03a54b58-e647-4a84-8c31-96e070c92f66 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:56.545885 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-03a54b58-e647-4a84-8c31-96e070c92f66 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:56.546551 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-03a54b58-e647-4a84-8c31-96e070c92f66 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:56.547604 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-03a54b58-e647-4a84-8c31-96e070c92f66 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:56.548230 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-03a54b58-e647-4a84-8c31-96e070c92f66 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:56.586359 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.objects.instance [None req-03a54b58-e647-4a84-8c31-96e070c92f66 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lazy-loading 'flavor' on Instance uuid e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 {{(pid=128925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:45:56.726173 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-03a54b58-e647-4a84-8c31-96e070c92f66 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "POST /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21/action" status: 200 len: 32 microversion: 2.1 time: 0.196349 May 10 16:45:56.726918 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 76/152] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 16:45:56 2022] POST /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 16:45:56.737080 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9f1a576d-82de-4c62-a478-bf8943e0a41d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:56.737710 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9f1a576d-82de-4c62-a478-bf8943e0a41d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:56.743558 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9f1a576d-82de-4c62-a478-bf8943e0a41d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:56.743996 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9f1a576d-82de-4c62-a478-bf8943e0a41d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:56.744740 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9f1a576d-82de-4c62-a478-bf8943e0a41d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:56.745337 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9f1a576d-82de-4c62-a478-bf8943e0a41d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:56.815939 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f75d7861-57e4-417d-936d-a7d19cf6bff6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:56.817502 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-f75d7861-57e4-417d-936d-a7d19cf6bff6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:56.825890 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f75d7861-57e4-417d-936d-a7d19cf6bff6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:56.826398 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f75d7861-57e4-417d-936d-a7d19cf6bff6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:56.828991 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f75d7861-57e4-417d-936d-a7d19cf6bff6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:56.829471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f75d7861-57e4-417d-936d-a7d19cf6bff6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:57.000348 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9f1a576d-82de-4c62-a478-bf8943e0a41d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:57.010782 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9f1a576d-82de-4c62-a478-bf8943e0a41d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.277528 May 10 16:45:57.012983 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 77/153] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:56 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:57.035498 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f75d7861-57e4-417d-936d-a7d19cf6bff6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:57.048807 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f75d7861-57e4-417d-936d-a7d19cf6bff6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:57.050750 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f75d7861-57e4-417d-936d-a7d19cf6bff6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:57.052521 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-f75d7861-57e4-417d-936d-a7d19cf6bff6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1407 microversion: 2.20 time: 0.241286 May 10 16:45:57.064245 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 77/154] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:56 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:45:58.029063 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-465bee05-76c6-46ed-aec2-10be16ce1ac6 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:58.029682 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-465bee05-76c6-46ed-aec2-10be16ce1ac6 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:58.036466 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-465bee05-76c6-46ed-aec2-10be16ce1ac6 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:58.037313 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-465bee05-76c6-46ed-aec2-10be16ce1ac6 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:58.038589 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-465bee05-76c6-46ed-aec2-10be16ce1ac6 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:58.039380 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-465bee05-76c6-46ed-aec2-10be16ce1ac6 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:58.072537 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-58d84e53-2904-469e-b46a-2e511e0f9fe4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:58.073136 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-58d84e53-2904-469e-b46a-2e511e0f9fe4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:58.081087 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-58d84e53-2904-469e-b46a-2e511e0f9fe4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:58.087376 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-58d84e53-2904-469e-b46a-2e511e0f9fe4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:58.088284 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-58d84e53-2904-469e-b46a-2e511e0f9fe4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:58.088720 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-58d84e53-2904-469e-b46a-2e511e0f9fe4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:58.229566 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-465bee05-76c6-46ed-aec2-10be16ce1ac6 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:58.237662 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-465bee05-76c6-46ed-aec2-10be16ce1ac6 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.212360 May 10 16:45:58.240721 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 78/155] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:58 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:45:58.303734 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-58d84e53-2904-469e-b46a-2e511e0f9fe4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:58.315607 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-58d84e53-2904-469e-b46a-2e511e0f9fe4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:58.317884 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-58d84e53-2904-469e-b46a-2e511e0f9fe4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:58.319279 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-58d84e53-2904-469e-b46a-2e511e0f9fe4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1600 microversion: 2.20 time: 0.251050 May 10 16:45:58.319826 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 78/156] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:45:58 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1600 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:45:58.337352 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4843e6ff-33d9-4b87-9133-274e86027b01 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:58.337832 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4843e6ff-33d9-4b87-9133-274e86027b01 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:58.344255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4843e6ff-33d9-4b87-9133-274e86027b01 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:58.344709 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4843e6ff-33d9-4b87-9133-274e86027b01 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:58.345488 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4843e6ff-33d9-4b87-9133-274e86027b01 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:58.345924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4843e6ff-33d9-4b87-9133-274e86027b01 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:58.495815 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4843e6ff-33d9-4b87-9133-274e86027b01 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.162174 May 10 16:45:58.503585 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 79/157] 10.222.0.57 () {60 vars in 1315 bytes} [Tue May 10 16:45:58 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-interface => generated 285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:45:59.257133 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-4c673cee-3808-4a25-b0d5-caf4952cf3c4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:45:59.258656 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-4c673cee-3808-4a25-b0d5-caf4952cf3c4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:45:59.270453 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4c673cee-3808-4a25-b0d5-caf4952cf3c4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:59.271209 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4c673cee-3808-4a25-b0d5-caf4952cf3c4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:59.272392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4c673cee-3808-4a25-b0d5-caf4952cf3c4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:45:59.273676 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4c673cee-3808-4a25-b0d5-caf4952cf3c4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:45:59.755042 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-4c673cee-3808-4a25-b0d5-caf4952cf3c4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:45:59.760476 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-4c673cee-3808-4a25-b0d5-caf4952cf3c4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.506962 May 10 16:45:59.761684 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 79/158] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:45:59 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:00.445551 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-a95096e6-0cb5-4288-a29c-fd2fa79450d5 req-20347261-c928-4e86-b06c-e6fee0b72ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a49eb5-dff1-452f-9e73-a8a9b0c64649", "tag": "0e22ce60-edf0-4181-80b7-08f1d62c396b"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:46:00.454091 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-a95096e6-0cb5-4288-a29c-fd2fa79450d5 req-20347261-c928-4e86-b06c-e6fee0b72ebe service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:00.454535 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-a95096e6-0cb5-4288-a29c-fd2fa79450d5 req-20347261-c928-4e86-b06c-e6fee0b72ebe service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:00.471475 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-a95096e6-0cb5-4288-a29c-fd2fa79450d5 req-20347261-c928-4e86-b06c-e6fee0b72ebe service nova] Creating event network-changed:0e22ce60-edf0-4181-80b7-08f1d62c396b for instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 on hv-cinder-84130 May 10 16:46:00.478486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-a95096e6-0cb5-4288-a29c-fd2fa79450d5 req-20347261-c928-4e86-b06c-e6fee0b72ebe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036474 May 10 16:46:00.484295 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 80/159] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:46:00.778289 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-672099cc-d45f-47ce-aef9-cc45d00691dc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:00.778907 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-672099cc-d45f-47ce-aef9-cc45d00691dc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:00.789274 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-672099cc-d45f-47ce-aef9-cc45d00691dc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:00.791507 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-672099cc-d45f-47ce-aef9-cc45d00691dc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:00.794629 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-672099cc-d45f-47ce-aef9-cc45d00691dc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:00.795252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-672099cc-d45f-47ce-aef9-cc45d00691dc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:01.040436 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-672099cc-d45f-47ce-aef9-cc45d00691dc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:01.053641 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-672099cc-d45f-47ce-aef9-cc45d00691dc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.279169 May 10 16:46:01.054944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 80/160] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:00 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:02.071951 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6900bbf7-ae80-4bc7-a8bb-e52359b1caaf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:02.072708 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6900bbf7-ae80-4bc7-a8bb-e52359b1caaf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:02.079007 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6900bbf7-ae80-4bc7-a8bb-e52359b1caaf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:02.079461 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6900bbf7-ae80-4bc7-a8bb-e52359b1caaf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:02.080228 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6900bbf7-ae80-4bc7-a8bb-e52359b1caaf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:02.080662 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6900bbf7-ae80-4bc7-a8bb-e52359b1caaf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:02.221302 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6900bbf7-ae80-4bc7-a8bb-e52359b1caaf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:02.228574 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6900bbf7-ae80-4bc7-a8bb-e52359b1caaf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.161575 May 10 16:46:02.229154 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 81/161] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:02 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:03.245503 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-2fa45435-46c0-4b07-8eaa-212b5a8f511b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:03.246908 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-2fa45435-46c0-4b07-8eaa-212b5a8f511b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:03.254333 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2fa45435-46c0-4b07-8eaa-212b5a8f511b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:03.255103 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2fa45435-46c0-4b07-8eaa-212b5a8f511b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:03.255896 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2fa45435-46c0-4b07-8eaa-212b5a8f511b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:03.256362 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2fa45435-46c0-4b07-8eaa-212b5a8f511b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:03.457743 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-2fa45435-46c0-4b07-8eaa-212b5a8f511b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:03.468772 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-2fa45435-46c0-4b07-8eaa-212b5a8f511b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.226948 May 10 16:46:03.469776 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 81/162] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:03 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:04.485954 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d419d895-edd7-49df-a11a-6a53d0f74dda tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:04.486590 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d419d895-edd7-49df-a11a-6a53d0f74dda tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:04.492378 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d419d895-edd7-49df-a11a-6a53d0f74dda tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:04.492824 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d419d895-edd7-49df-a11a-6a53d0f74dda tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:04.493584 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d419d895-edd7-49df-a11a-6a53d0f74dda tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:04.494018 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d419d895-edd7-49df-a11a-6a53d0f74dda tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:04.620881 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d419d895-edd7-49df-a11a-6a53d0f74dda tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:04.629723 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d419d895-edd7-49df-a11a-6a53d0f74dda tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.148041 May 10 16:46:04.630294 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 82/163] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:04 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:04.763239 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-bde8586d-0f9b-4a4f-98b7-8d26144f1381 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-224520884", "imageRef": "3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b", "flavorRef": "452", "networks": [{"uuid": "b40552e4-6362-447e-b70b-8f9f6a46c3b4"}]}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:46:04.820767 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.network.neutron [None req-bde8586d-0f9b-4a4f-98b7-8d26144f1381 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] validate_networks() for [('b40552e4-6362-447e-b70b-8f9f6a46c3b4', None, None, None, None, None)] {{(pid=128925) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:46:05.188682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-bde8586d-0f9b-4a4f-98b7-8d26144f1381 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Flavor limits 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:46:05.189194 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-bde8586d-0f9b-4a4f-98b7-8d26144f1381 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Image limits 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:46:05.189897 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-bde8586d-0f9b-4a4f-98b7-8d26144f1381 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Flavor pref 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:46:05.190528 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-bde8586d-0f9b-4a4f-98b7-8d26144f1381 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Image pref 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:46:05.191122 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-bde8586d-0f9b-4a4f-98b7-8d26144f1381 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:46:05.200135 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-bde8586d-0f9b-4a4f-98b7-8d26144f1381 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:05.200588 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-bde8586d-0f9b-4a4f-98b7-8d26144f1381 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:05.201392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-bde8586d-0f9b-4a4f-98b7-8d26144f1381 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:05.201828 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-bde8586d-0f9b-4a4f-98b7-8d26144f1381 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:05.223296 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-bde8586d-0f9b-4a4f-98b7-8d26144f1381 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Getting quotas for project afe9c1d72ca84e33b3431738acf61295. Resources: {'instances', 'cores', 'ram'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:46:05.230421 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-bde8586d-0f9b-4a4f-98b7-8d26144f1381 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Getting quotas for user 8f85454e20524acdb9d2dd01d8a71c27 and project afe9c1d72ca84e33b3431738acf61295. Resources: {'instances', 'cores', 'ram'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:46:05.244576 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-bde8586d-0f9b-4a4f-98b7-8d26144f1381 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Going to run 1 instances... {{(pid=128925) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:46:05.247128 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-bde8586d-0f9b-4a4f-98b7-8d26144f1381 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128925) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:46:05.309943 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-bde8586d-0f9b-4a4f-98b7-8d26144f1381 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551841 May 10 16:46:05.310689 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 82/164] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 16:46:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:46:05.321145 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e1c658ce-3442-4405-87ff-e150979992d0 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:05.321810 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e1c658ce-3442-4405-87ff-e150979992d0 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:05.388962 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e1c658ce-3442-4405-87ff-e150979992d0 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:05.395718 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e1c658ce-3442-4405-87ff-e150979992d0 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1213 microversion: 2.1 time: 0.078203 May 10 16:46:05.396227 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 83/165] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:05 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:05.648085 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1c533db6-cc10-41ee-997c-6a03d6b79699 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:05.649314 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-1c533db6-cc10-41ee-997c-6a03d6b79699 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:05.660380 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1c533db6-cc10-41ee-997c-6a03d6b79699 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:05.661288 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1c533db6-cc10-41ee-997c-6a03d6b79699 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:05.662699 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1c533db6-cc10-41ee-997c-6a03d6b79699 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:05.664611 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1c533db6-cc10-41ee-997c-6a03d6b79699 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:05.854761 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-1c533db6-cc10-41ee-997c-6a03d6b79699 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:05.876282 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-1c533db6-cc10-41ee-997c-6a03d6b79699 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.234261 May 10 16:46:05.890297 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 83/166] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:05 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:06.412994 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0dc13298-24d3-4d5c-863e-7a0f4a2e70ae tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:06.413587 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0dc13298-24d3-4d5c-863e-7a0f4a2e70ae tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:06.419362 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0dc13298-24d3-4d5c-863e-7a0f4a2e70ae tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:06.419804 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0dc13298-24d3-4d5c-863e-7a0f4a2e70ae tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:06.420568 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0dc13298-24d3-4d5c-863e-7a0f4a2e70ae tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:06.421571 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0dc13298-24d3-4d5c-863e-7a0f4a2e70ae tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:06.487439 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0dc13298-24d3-4d5c-863e-7a0f4a2e70ae tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:06.495259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0dc13298-24d3-4d5c-863e-7a0f4a2e70ae tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1265 microversion: 2.1 time: 0.085697 May 10 16:46:06.495827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 84/167] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:06 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:06.908205 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-fa51aa56-51ac-4bc6-aa08-96a23bd1a6d3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:06.909034 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-fa51aa56-51ac-4bc6-aa08-96a23bd1a6d3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:06.918043 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fa51aa56-51ac-4bc6-aa08-96a23bd1a6d3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:06.919581 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fa51aa56-51ac-4bc6-aa08-96a23bd1a6d3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:06.921162 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fa51aa56-51ac-4bc6-aa08-96a23bd1a6d3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:06.921610 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fa51aa56-51ac-4bc6-aa08-96a23bd1a6d3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:07.125910 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-fa51aa56-51ac-4bc6-aa08-96a23bd1a6d3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:07.136548 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-fa51aa56-51ac-4bc6-aa08-96a23bd1a6d3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.233392 May 10 16:46:07.137151 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 84/168] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:06 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:07.514245 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f4879cec-22c2-4aec-bce2-f7e180d1b105 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:07.515581 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f4879cec-22c2-4aec-bce2-f7e180d1b105 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:07.522452 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f4879cec-22c2-4aec-bce2-f7e180d1b105 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:07.523393 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f4879cec-22c2-4aec-bce2-f7e180d1b105 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:07.524401 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f4879cec-22c2-4aec-bce2-f7e180d1b105 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:07.524904 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f4879cec-22c2-4aec-bce2-f7e180d1b105 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:07.727928 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f4879cec-22c2-4aec-bce2-f7e180d1b105 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:07.735337 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f4879cec-22c2-4aec-bce2-f7e180d1b105 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1313 microversion: 2.1 time: 0.226447 May 10 16:46:07.744898 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 85/169] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:07 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:08.153178 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-de74163e-7acc-40e0-80b5-f801e0309e21 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:08.154600 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-de74163e-7acc-40e0-80b5-f801e0309e21 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:08.161591 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-de74163e-7acc-40e0-80b5-f801e0309e21 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:08.162172 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-de74163e-7acc-40e0-80b5-f801e0309e21 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:08.163086 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-de74163e-7acc-40e0-80b5-f801e0309e21 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:08.163917 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-de74163e-7acc-40e0-80b5-f801e0309e21 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:08.341617 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-4ce13a86-f0e4-4219-aaf7-a5b24b764639 req-f562e842-9503-4355-8ed8-42e551dbadb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25942336-75cc-497f-8cdf-94017ee2fee6", "tag": "fab849a0-054d-452a-b121-5bf155a95f64"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:46:08.359609 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-4ce13a86-f0e4-4219-aaf7-a5b24b764639 req-f562e842-9503-4355-8ed8-42e551dbadb8 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:08.360086 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-4ce13a86-f0e4-4219-aaf7-a5b24b764639 req-f562e842-9503-4355-8ed8-42e551dbadb8 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:08.371640 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-de74163e-7acc-40e0-80b5-f801e0309e21 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:08.377664 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-4ce13a86-f0e4-4219-aaf7-a5b24b764639 req-f562e842-9503-4355-8ed8-42e551dbadb8 service nova] Creating event network-changed:fab849a0-054d-452a-b121-5bf155a95f64 for instance 25942336-75cc-497f-8cdf-94017ee2fee6 on hv-cinder-84130 May 10 16:46:08.380325 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-de74163e-7acc-40e0-80b5-f801e0309e21 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.230673 May 10 16:46:08.381263 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 85/170] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:08 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:08.383166 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-4ce13a86-f0e4-4219-aaf7-a5b24b764639 req-f562e842-9503-4355-8ed8-42e551dbadb8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046389 May 10 16:46:08.384037 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 86/171] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:46:08.751733 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-89751ff8-75cb-4ef3-8a6d-d8eb103637ab tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:08.752427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-89751ff8-75cb-4ef3-8a6d-d8eb103637ab tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:08.784114 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-89751ff8-75cb-4ef3-8a6d-d8eb103637ab tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:08.784578 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-89751ff8-75cb-4ef3-8a6d-d8eb103637ab tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:08.785778 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-89751ff8-75cb-4ef3-8a6d-d8eb103637ab tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:08.786299 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-89751ff8-75cb-4ef3-8a6d-d8eb103637ab tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:09.032399 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-89751ff8-75cb-4ef3-8a6d-d8eb103637ab tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:09.040839 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-89751ff8-75cb-4ef3-8a6d-d8eb103637ab tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1313 microversion: 2.1 time: 0.292941 May 10 16:46:09.041405 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 86/172] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:08 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:09.398447 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-eb74b6ad-7232-4a24-9444-120ea8312cbc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:09.399263 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-eb74b6ad-7232-4a24-9444-120ea8312cbc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:09.414749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-eb74b6ad-7232-4a24-9444-120ea8312cbc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:09.415225 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-eb74b6ad-7232-4a24-9444-120ea8312cbc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:09.416063 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-eb74b6ad-7232-4a24-9444-120ea8312cbc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:09.416460 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-eb74b6ad-7232-4a24-9444-120ea8312cbc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:09.764069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-eb74b6ad-7232-4a24-9444-120ea8312cbc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:09.773118 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-eb74b6ad-7232-4a24-9444-120ea8312cbc tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.378425 May 10 16:46:09.773698 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 87/173] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:09 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:10.058597 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-92f4fd5b-8d27-47cb-b372-c0fd24f20fe1 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:10.059278 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-92f4fd5b-8d27-47cb-b372-c0fd24f20fe1 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:10.065852 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-92f4fd5b-8d27-47cb-b372-c0fd24f20fe1 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:10.066303 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-92f4fd5b-8d27-47cb-b372-c0fd24f20fe1 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:10.067116 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-92f4fd5b-8d27-47cb-b372-c0fd24f20fe1 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:10.067556 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-92f4fd5b-8d27-47cb-b372-c0fd24f20fe1 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:10.229024 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-92f4fd5b-8d27-47cb-b372-c0fd24f20fe1 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:10.238708 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-92f4fd5b-8d27-47cb-b372-c0fd24f20fe1 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1313 microversion: 2.1 time: 0.183673 May 10 16:46:10.248255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 87/174] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:10 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:10.790247 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1f96490f-8d2a-4c49-88c2-c1bc94d1b155 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:10.793292 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1f96490f-8d2a-4c49-88c2-c1bc94d1b155 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:10.811007 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1f96490f-8d2a-4c49-88c2-c1bc94d1b155 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:10.815400 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1f96490f-8d2a-4c49-88c2-c1bc94d1b155 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:10.816297 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1f96490f-8d2a-4c49-88c2-c1bc94d1b155 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:10.817627 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1f96490f-8d2a-4c49-88c2-c1bc94d1b155 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:10.992028 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1f96490f-8d2a-4c49-88c2-c1bc94d1b155 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:11.000264 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1f96490f-8d2a-4c49-88c2-c1bc94d1b155 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.214133 May 10 16:46:11.000789 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 88/175] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:10 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:11.260063 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-2341888d-8c80-4bba-b7e0-1fbe3c937d2e tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:11.261316 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-2341888d-8c80-4bba-b7e0-1fbe3c937d2e tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:11.270196 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2341888d-8c80-4bba-b7e0-1fbe3c937d2e tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:11.270733 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2341888d-8c80-4bba-b7e0-1fbe3c937d2e tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:11.271751 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2341888d-8c80-4bba-b7e0-1fbe3c937d2e tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:11.272192 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2341888d-8c80-4bba-b7e0-1fbe3c937d2e tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:11.477188 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-2341888d-8c80-4bba-b7e0-1fbe3c937d2e tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:11.486094 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-2341888d-8c80-4bba-b7e0-1fbe3c937d2e tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1313 microversion: 2.1 time: 0.233610 May 10 16:46:11.487079 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 88/176] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:11 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:12.021872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-12c62952-af99-40b5-89e4-6d93b610dde2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:12.022549 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-12c62952-af99-40b5-89e4-6d93b610dde2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:12.043614 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-12c62952-af99-40b5-89e4-6d93b610dde2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:12.046081 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-12c62952-af99-40b5-89e4-6d93b610dde2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:12.048086 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-12c62952-af99-40b5-89e4-6d93b610dde2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:12.049539 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-12c62952-af99-40b5-89e4-6d93b610dde2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:12.269254 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-12c62952-af99-40b5-89e4-6d93b610dde2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:12.290236 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-12c62952-af99-40b5-89e4-6d93b610dde2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.274615 May 10 16:46:12.299283 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 89/177] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:12 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:12.503312 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f32cd42e-2d0e-48b4-b0f9-0eee135c5a15 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:12.504740 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-f32cd42e-2d0e-48b4-b0f9-0eee135c5a15 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:12.515626 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f32cd42e-2d0e-48b4-b0f9-0eee135c5a15 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:12.517357 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f32cd42e-2d0e-48b4-b0f9-0eee135c5a15 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:12.524122 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f32cd42e-2d0e-48b4-b0f9-0eee135c5a15 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:12.524722 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f32cd42e-2d0e-48b4-b0f9-0eee135c5a15 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:12.738999 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f32cd42e-2d0e-48b4-b0f9-0eee135c5a15 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:12.750750 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-f32cd42e-2d0e-48b4-b0f9-0eee135c5a15 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1313 microversion: 2.1 time: 0.250355 May 10 16:46:12.751963 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 89/178] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:12 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:12.884624 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2a4d1c71-3b63-4d45-97d4-90b494e17bae tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:12.885352 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2a4d1c71-3b63-4d45-97d4-90b494e17bae tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:12.894544 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a4d1c71-3b63-4d45-97d4-90b494e17bae tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:12.895309 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a4d1c71-3b63-4d45-97d4-90b494e17bae tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:12.896619 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a4d1c71-3b63-4d45-97d4-90b494e17bae tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:12.898392 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a4d1c71-3b63-4d45-97d4-90b494e17bae tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:12.930659 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2a4d1c71-3b63-4d45-97d4-90b494e17bae tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:46:13.044987 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2a4d1c71-3b63-4d45-97d4-90b494e17bae tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 204 len: 0 microversion: 2.1 time: 0.163867 May 10 16:46:13.046620 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 90/179] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 16:46:12 2022] DELETE /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:46:13.058483 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-9189f433-cc60-427b-b06c-707ccefdeea5 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:13.059136 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-9189f433-cc60-427b-b06c-707ccefdeea5 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:13.067176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9189f433-cc60-427b-b06c-707ccefdeea5 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:13.067657 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9189f433-cc60-427b-b06c-707ccefdeea5 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:13.072970 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9189f433-cc60-427b-b06c-707ccefdeea5 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:13.073466 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9189f433-cc60-427b-b06c-707ccefdeea5 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:13.299439 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-9189f433-cc60-427b-b06c-707ccefdeea5 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:13.309305 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-9189f433-cc60-427b-b06c-707ccefdeea5 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1554 microversion: 2.1 time: 0.255072 May 10 16:46:13.310596 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 90/180] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:13 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1554 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:13.312504 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4e1ba5a0-5426-4a38-835c-a027d8bcb107 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:13.313526 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4e1ba5a0-5426-4a38-835c-a027d8bcb107 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:13.320825 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4e1ba5a0-5426-4a38-835c-a027d8bcb107 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:13.321390 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4e1ba5a0-5426-4a38-835c-a027d8bcb107 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:13.322262 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4e1ba5a0-5426-4a38-835c-a027d8bcb107 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:13.322922 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4e1ba5a0-5426-4a38-835c-a027d8bcb107 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:13.508088 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4e1ba5a0-5426-4a38-835c-a027d8bcb107 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:13.516351 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4e1ba5a0-5426-4a38-835c-a027d8bcb107 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.211200 May 10 16:46:13.517095 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 91/181] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:13 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:13.769236 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-a2fea0c9-6957-45eb-a8a1-101468ea11d2 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:13.769854 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-a2fea0c9-6957-45eb-a8a1-101468ea11d2 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:13.776698 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a2fea0c9-6957-45eb-a8a1-101468ea11d2 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:13.777535 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a2fea0c9-6957-45eb-a8a1-101468ea11d2 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:13.778483 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a2fea0c9-6957-45eb-a8a1-101468ea11d2 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:13.779022 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a2fea0c9-6957-45eb-a8a1-101468ea11d2 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:13.973375 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-a2fea0c9-6957-45eb-a8a1-101468ea11d2 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:13.981946 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-a2fea0c9-6957-45eb-a8a1-101468ea11d2 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1313 microversion: 2.1 time: 0.217663 May 10 16:46:13.984364 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 91/182] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:13 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:14.100915 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-cb238f3a-c36c-418d-a321-3464c1e60d07 req-e4bbad03-f009-417b-abba-0fe52740b858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25942336-75cc-497f-8cdf-94017ee2fee6", "name": "network-vif-plugged", "status": "completed", "tag": "fab849a0-054d-452a-b121-5bf155a95f64"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:46:14.114663 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-cb238f3a-c36c-418d-a321-3464c1e60d07 req-e4bbad03-f009-417b-abba-0fe52740b858 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:14.115234 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-cb238f3a-c36c-418d-a321-3464c1e60d07 req-e4bbad03-f009-417b-abba-0fe52740b858 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:14.131544 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-cb238f3a-c36c-418d-a321-3464c1e60d07 req-e4bbad03-f009-417b-abba-0fe52740b858 service nova] Creating event network-vif-plugged:fab849a0-054d-452a-b121-5bf155a95f64 for instance 25942336-75cc-497f-8cdf-94017ee2fee6 on hv-cinder-84130 May 10 16:46:14.138166 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-cb238f3a-c36c-418d-a321-3464c1e60d07 req-e4bbad03-f009-417b-abba-0fe52740b858 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043817 May 10 16:46:14.138899 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 92/183] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:46:14.327731 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-23f16fce-37bc-4a9d-b2d3-8cef19362d93 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:14.328577 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-23f16fce-37bc-4a9d-b2d3-8cef19362d93 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:14.334502 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-23f16fce-37bc-4a9d-b2d3-8cef19362d93 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:14.335111 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-23f16fce-37bc-4a9d-b2d3-8cef19362d93 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:14.336078 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-23f16fce-37bc-4a9d-b2d3-8cef19362d93 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:14.336605 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-23f16fce-37bc-4a9d-b2d3-8cef19362d93 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:14.533983 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7fb91832-ec2c-4ca3-a993-d97e6b328f32 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:14.545794 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7fb91832-ec2c-4ca3-a993-d97e6b328f32 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:14.557316 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7fb91832-ec2c-4ca3-a993-d97e6b328f32 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:14.557812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7fb91832-ec2c-4ca3-a993-d97e6b328f32 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:14.558847 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7fb91832-ec2c-4ca3-a993-d97e6b328f32 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:14.559237 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7fb91832-ec2c-4ca3-a993-d97e6b328f32 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:14.760386 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-23f16fce-37bc-4a9d-b2d3-8cef19362d93 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:14.769211 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-23f16fce-37bc-4a9d-b2d3-8cef19362d93 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1554 microversion: 2.1 time: 0.446368 May 10 16:46:14.769874 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 92/184] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:14 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1554 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:14.779645 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7fb91832-ec2c-4ca3-a993-d97e6b328f32 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:14.787304 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7fb91832-ec2c-4ca3-a993-d97e6b328f32 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.257683 May 10 16:46:14.788163 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 93/185] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:14 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:46:15.006898 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-62a3e06a-e180-42ff-80c8-b7a858dd6771 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:15.007825 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-62a3e06a-e180-42ff-80c8-b7a858dd6771 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:15.015671 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-62a3e06a-e180-42ff-80c8-b7a858dd6771 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:15.016316 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-62a3e06a-e180-42ff-80c8-b7a858dd6771 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:15.017367 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-62a3e06a-e180-42ff-80c8-b7a858dd6771 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:15.018335 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-62a3e06a-e180-42ff-80c8-b7a858dd6771 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:15.235275 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-62a3e06a-e180-42ff-80c8-b7a858dd6771 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:15.244599 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-62a3e06a-e180-42ff-80c8-b7a858dd6771 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1313 microversion: 2.1 time: 0.246310 May 10 16:46:15.245274 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 93/186] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:14 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:46:15.789188 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fcc16c86-6106-45a7-a28d-924bb2650d6c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:15.789863 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-fcc16c86-6106-45a7-a28d-924bb2650d6c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:15.796980 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fcc16c86-6106-45a7-a28d-924bb2650d6c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:15.797754 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fcc16c86-6106-45a7-a28d-924bb2650d6c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:15.799264 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fcc16c86-6106-45a7-a28d-924bb2650d6c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:15.799844 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fcc16c86-6106-45a7-a28d-924bb2650d6c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:15.806224 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-fc8a6c72-0ca6-4bec-9772-a48f2a7971d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:15.807522 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-fc8a6c72-0ca6-4bec-9772-a48f2a7971d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:15.824261 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fc8a6c72-0ca6-4bec-9772-a48f2a7971d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:15.824775 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fc8a6c72-0ca6-4bec-9772-a48f2a7971d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:15.825562 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fc8a6c72-0ca6-4bec-9772-a48f2a7971d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:15.825990 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fc8a6c72-0ca6-4bec-9772-a48f2a7971d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:16.068671 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-fc8a6c72-0ca6-4bec-9772-a48f2a7971d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:16.078423 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-fc8a6c72-0ca6-4bec-9772-a48f2a7971d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.277174 May 10 16:46:16.079165 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 94/187] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:15 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:16.094921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fcc16c86-6106-45a7-a28d-924bb2650d6c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:16.104943 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fcc16c86-6106-45a7-a28d-924bb2650d6c tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1554 microversion: 2.1 time: 0.321233 May 10 16:46:16.105746 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 94/188] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:15 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1554 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:16.261960 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b704c754-3bdb-42c6-99b6-fe5eb0b0ab4b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:16.262571 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-b704c754-3bdb-42c6-99b6-fe5eb0b0ab4b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:16.269665 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b704c754-3bdb-42c6-99b6-fe5eb0b0ab4b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:16.270579 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b704c754-3bdb-42c6-99b6-fe5eb0b0ab4b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:16.271250 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b704c754-3bdb-42c6-99b6-fe5eb0b0ab4b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:16.271685 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b704c754-3bdb-42c6-99b6-fe5eb0b0ab4b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:16.427356 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b704c754-3bdb-42c6-99b6-fe5eb0b0ab4b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:16.435646 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b704c754-3bdb-42c6-99b6-fe5eb0b0ab4b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1313 microversion: 2.1 time: 0.177610 May 10 16:46:16.436961 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 95/189] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:16 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:17.096258 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ae5510f7-2364-491c-99e2-0149c9fdb83f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:17.096870 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ae5510f7-2364-491c-99e2-0149c9fdb83f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:17.102689 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ae5510f7-2364-491c-99e2-0149c9fdb83f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:17.103166 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ae5510f7-2364-491c-99e2-0149c9fdb83f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:17.103935 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ae5510f7-2364-491c-99e2-0149c9fdb83f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:17.104367 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ae5510f7-2364-491c-99e2-0149c9fdb83f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:17.121402 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-6d30bfea-6dac-443b-9387-21111efd85b4 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:17.122197 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-6d30bfea-6dac-443b-9387-21111efd85b4 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:17.128565 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6d30bfea-6dac-443b-9387-21111efd85b4 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:17.129091 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6d30bfea-6dac-443b-9387-21111efd85b4 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:17.129938 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6d30bfea-6dac-443b-9387-21111efd85b4 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:17.130439 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6d30bfea-6dac-443b-9387-21111efd85b4 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:17.323701 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ae5510f7-2364-491c-99e2-0149c9fdb83f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:17.331624 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ae5510f7-2364-491c-99e2-0149c9fdb83f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.239574 May 10 16:46:17.332367 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 95/190] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:17 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:17.334654 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6d30bfea-6dac-443b-9387-21111efd85b4 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:17.343409 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-6d30bfea-6dac-443b-9387-21111efd85b4 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1554 microversion: 2.1 time: 0.225778 May 10 16:46:17.343976 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 96/191] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:17 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1554 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:46:17.452940 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a8a784ee-d83e-413a-bdc2-63873f5639e8 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:17.453652 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a8a784ee-d83e-413a-bdc2-63873f5639e8 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:17.459664 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a8a784ee-d83e-413a-bdc2-63873f5639e8 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:17.460185 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a8a784ee-d83e-413a-bdc2-63873f5639e8 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:17.461033 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a8a784ee-d83e-413a-bdc2-63873f5639e8 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:17.461546 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a8a784ee-d83e-413a-bdc2-63873f5639e8 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:17.645599 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a8a784ee-d83e-413a-bdc2-63873f5639e8 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:17.653574 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a8a784ee-d83e-413a-bdc2-63873f5639e8 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1313 microversion: 2.1 time: 0.204862 May 10 16:46:17.654223 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 96/192] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:17 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:18.349217 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-7587efe5-237f-4fd4-84af-876fa7b0896e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:18.350508 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-7587efe5-237f-4fd4-84af-876fa7b0896e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:18.357213 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7587efe5-237f-4fd4-84af-876fa7b0896e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:18.358690 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7587efe5-237f-4fd4-84af-876fa7b0896e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:18.359693 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7587efe5-237f-4fd4-84af-876fa7b0896e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:18.360280 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7587efe5-237f-4fd4-84af-876fa7b0896e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:18.363130 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-698bc760-4d1b-4eb9-828f-d23c99150d7d tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:18.364616 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-698bc760-4d1b-4eb9-828f-d23c99150d7d tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:18.390700 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-698bc760-4d1b-4eb9-828f-d23c99150d7d tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:18.391360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-698bc760-4d1b-4eb9-828f-d23c99150d7d tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:18.394720 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-698bc760-4d1b-4eb9-828f-d23c99150d7d tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:18.396391 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-698bc760-4d1b-4eb9-828f-d23c99150d7d tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:18.603906 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7587efe5-237f-4fd4-84af-876fa7b0896e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:18.612391 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-7587efe5-237f-4fd4-84af-876fa7b0896e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.267197 May 10 16:46:18.613315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 97/193] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:18 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:18.635955 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-698bc760-4d1b-4eb9-828f-d23c99150d7d tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:18.644986 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-698bc760-4d1b-4eb9-828f-d23c99150d7d tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1554 microversion: 2.1 time: 0.287893 May 10 16:46:18.645565 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 97/194] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:18 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1554 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:46:18.671642 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1fc035eb-5943-4aa7-8cbb-1e2db5dde371 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:18.672322 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-1fc035eb-5943-4aa7-8cbb-1e2db5dde371 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:18.681496 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1fc035eb-5943-4aa7-8cbb-1e2db5dde371 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:18.682075 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1fc035eb-5943-4aa7-8cbb-1e2db5dde371 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:18.683202 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1fc035eb-5943-4aa7-8cbb-1e2db5dde371 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:18.683713 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1fc035eb-5943-4aa7-8cbb-1e2db5dde371 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:18.883105 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-1fc035eb-5943-4aa7-8cbb-1e2db5dde371 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:18.896249 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-1fc035eb-5943-4aa7-8cbb-1e2db5dde371 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1313 microversion: 2.1 time: 0.230166 May 10 16:46:18.896810 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 98/195] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:18 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:19.230835 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-ba473838-7cf0-4a02-8dad-1c4461db9c0b req-948f24fe-055a-419c-ad19-3e55a6ea4225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbae1dbd-c3ef-4359-862c-9b73b101ef90", "name": "network-vif-deleted", "tag": "20a97eae-5fb9-4e5a-b1dd-5a0da85c66c4"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:46:19.240929 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-ba473838-7cf0-4a02-8dad-1c4461db9c0b req-948f24fe-055a-419c-ad19-3e55a6ea4225 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:19.241363 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-ba473838-7cf0-4a02-8dad-1c4461db9c0b req-948f24fe-055a-419c-ad19-3e55a6ea4225 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:19.252935 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-ba473838-7cf0-4a02-8dad-1c4461db9c0b req-948f24fe-055a-419c-ad19-3e55a6ea4225 service nova] Creating event network-vif-deleted:20a97eae-5fb9-4e5a-b1dd-5a0da85c66c4 for instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 on hv-cinder-84130 May 10 16:46:19.257686 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-ba473838-7cf0-4a02-8dad-1c4461db9c0b req-948f24fe-055a-419c-ad19-3e55a6ea4225 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031850 May 10 16:46:19.258271 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 98/196] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:46:19.630221 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-aa359c40-1928-41dd-a093-d2b7f291c5d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:19.630830 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-aa359c40-1928-41dd-a093-d2b7f291c5d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:19.637214 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-aa359c40-1928-41dd-a093-d2b7f291c5d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:19.637663 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-aa359c40-1928-41dd-a093-d2b7f291c5d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:19.638435 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-aa359c40-1928-41dd-a093-d2b7f291c5d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:19.638870 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-aa359c40-1928-41dd-a093-d2b7f291c5d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:19.670807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-18bb599e-58b3-490f-9223-f667a4c12582 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:19.671699 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-18bb599e-58b3-490f-9223-f667a4c12582 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:19.680499 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-18bb599e-58b3-490f-9223-f667a4c12582 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:19.682039 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-18bb599e-58b3-490f-9223-f667a4c12582 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:19.687277 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-18bb599e-58b3-490f-9223-f667a4c12582 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:19.687736 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-18bb599e-58b3-490f-9223-f667a4c12582 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:19.774791 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-18bb599e-58b3-490f-9223-f667a4c12582 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:19.784625 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-18bb599e-58b3-490f-9223-f667a4c12582 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1346 microversion: 2.1 time: 0.118613 May 10 16:46:19.785202 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 99/197] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:19 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1346 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:46:19.820236 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-aa359c40-1928-41dd-a093-d2b7f291c5d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:19.828094 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-aa359c40-1928-41dd-a093-d2b7f291c5d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.201768 May 10 16:46:19.837633 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 99/198] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:19 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:19.916497 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a252a773-d40d-4974-aab6-c0cc0b6faf11 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:19.921293 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a252a773-d40d-4974-aab6-c0cc0b6faf11 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:19.928454 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a252a773-d40d-4974-aab6-c0cc0b6faf11 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:19.929010 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a252a773-d40d-4974-aab6-c0cc0b6faf11 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:19.929924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a252a773-d40d-4974-aab6-c0cc0b6faf11 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:19.930429 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a252a773-d40d-4974-aab6-c0cc0b6faf11 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:20.076508 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a252a773-d40d-4974-aab6-c0cc0b6faf11 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:20.084203 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a252a773-d40d-4974-aab6-c0cc0b6faf11 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1313 microversion: 2.1 time: 0.174340 May 10 16:46:20.084760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 100/199] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:19 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:20.802550 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-e247b602-61b0-46e3-a3e5-5826c2e93376 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:20.803310 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-e247b602-61b0-46e3-a3e5-5826c2e93376 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:20.809731 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e247b602-61b0-46e3-a3e5-5826c2e93376 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:20.810177 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e247b602-61b0-46e3-a3e5-5826c2e93376 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:20.811483 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e247b602-61b0-46e3-a3e5-5826c2e93376 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:20.811923 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e247b602-61b0-46e3-a3e5-5826c2e93376 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:20.846192 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6b1932db-a7a8-4b96-872a-7eeca2ae65f9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:20.846802 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6b1932db-a7a8-4b96-872a-7eeca2ae65f9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:20.854701 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6b1932db-a7a8-4b96-872a-7eeca2ae65f9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:20.855304 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6b1932db-a7a8-4b96-872a-7eeca2ae65f9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:20.856207 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6b1932db-a7a8-4b96-872a-7eeca2ae65f9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:20.856642 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6b1932db-a7a8-4b96-872a-7eeca2ae65f9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:20.881278 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-e247b602-61b0-46e3-a3e5-5826c2e93376 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:20.891214 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-e247b602-61b0-46e3-a3e5-5826c2e93376 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1346 microversion: 2.1 time: 0.092730 May 10 16:46:20.892015 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 100/200] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:20 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:21.020206 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6b1932db-a7a8-4b96-872a-7eeca2ae65f9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:21.028193 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6b1932db-a7a8-4b96-872a-7eeca2ae65f9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.186793 May 10 16:46:21.028872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 101/201] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:20 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:21.102165 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-cb31fe5b-be69-4dae-81df-d9283a4a5c37 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:21.102806 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-cb31fe5b-be69-4dae-81df-d9283a4a5c37 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:21.109344 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-cb31fe5b-be69-4dae-81df-d9283a4a5c37 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:21.109790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-cb31fe5b-be69-4dae-81df-d9283a4a5c37 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:21.110557 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-cb31fe5b-be69-4dae-81df-d9283a4a5c37 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:21.111014 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-cb31fe5b-be69-4dae-81df-d9283a4a5c37 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:21.248926 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-cb31fe5b-be69-4dae-81df-d9283a4a5c37 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:21.256236 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-cb31fe5b-be69-4dae-81df-d9283a4a5c37 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1313 microversion: 2.1 time: 0.158005 May 10 16:46:21.256791 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 101/202] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:21 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:21.908187 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-892cd414-c998-4a38-9227-4bfed414cad7 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:21.908796 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-892cd414-c998-4a38-9227-4bfed414cad7 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:21.914445 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-892cd414-c998-4a38-9227-4bfed414cad7 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:21.914888 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-892cd414-c998-4a38-9227-4bfed414cad7 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:21.915675 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-892cd414-c998-4a38-9227-4bfed414cad7 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:21.916107 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-892cd414-c998-4a38-9227-4bfed414cad7 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:21.980483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-892cd414-c998-4a38-9227-4bfed414cad7 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:21.988803 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-892cd414-c998-4a38-9227-4bfed414cad7 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1346 microversion: 2.1 time: 0.084345 May 10 16:46:21.989568 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 102/203] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:21 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1346 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:22.045254 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-89280cab-cff3-413f-a6cd-d39373dcb8ef tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:22.046499 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-89280cab-cff3-413f-a6cd-d39373dcb8ef tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:22.053218 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-89280cab-cff3-413f-a6cd-d39373dcb8ef tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:22.053853 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-89280cab-cff3-413f-a6cd-d39373dcb8ef tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:22.054995 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-89280cab-cff3-413f-a6cd-d39373dcb8ef tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:22.055441 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-89280cab-cff3-413f-a6cd-d39373dcb8ef tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:22.193010 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-89280cab-cff3-413f-a6cd-d39373dcb8ef tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:22.200346 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-89280cab-cff3-413f-a6cd-d39373dcb8ef tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.159148 May 10 16:46:22.200916 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 102/204] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:22 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:22.273449 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c5152ea9-7a72-4ab5-a331-b0bbb8fe698b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:22.274452 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c5152ea9-7a72-4ab5-a331-b0bbb8fe698b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:22.281068 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c5152ea9-7a72-4ab5-a331-b0bbb8fe698b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:22.281525 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c5152ea9-7a72-4ab5-a331-b0bbb8fe698b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:22.282304 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c5152ea9-7a72-4ab5-a331-b0bbb8fe698b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:22.282743 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c5152ea9-7a72-4ab5-a331-b0bbb8fe698b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:22.412058 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c5152ea9-7a72-4ab5-a331-b0bbb8fe698b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:22.419410 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c5152ea9-7a72-4ab5-a331-b0bbb8fe698b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1313 microversion: 2.1 time: 0.149668 May 10 16:46:22.419984 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 103/205] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:22 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:23.005473 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-74b8cea1-b353-4567-badb-f3002265392a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:23.006216 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-74b8cea1-b353-4567-badb-f3002265392a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:23.012796 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-74b8cea1-b353-4567-badb-f3002265392a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:23.013241 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-74b8cea1-b353-4567-badb-f3002265392a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:23.014077 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-74b8cea1-b353-4567-badb-f3002265392a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:23.015076 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-74b8cea1-b353-4567-badb-f3002265392a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:23.084893 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-74b8cea1-b353-4567-badb-f3002265392a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:23.093119 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-74b8cea1-b353-4567-badb-f3002265392a tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1346 microversion: 2.1 time: 0.091633 May 10 16:46:23.093736 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 103/206] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:23 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:23.217105 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-004dde86-d18f-4a5e-b4e4-22dde58043e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:23.217732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-004dde86-d18f-4a5e-b4e4-22dde58043e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:23.223500 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-004dde86-d18f-4a5e-b4e4-22dde58043e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:23.223947 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-004dde86-d18f-4a5e-b4e4-22dde58043e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:23.224720 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-004dde86-d18f-4a5e-b4e4-22dde58043e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:23.225160 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-004dde86-d18f-4a5e-b4e4-22dde58043e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:23.370764 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-004dde86-d18f-4a5e-b4e4-22dde58043e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:23.378732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-004dde86-d18f-4a5e-b4e4-22dde58043e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.165506 May 10 16:46:23.379334 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 104/207] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:23 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:23.436985 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-80c3f879-2eea-40e4-ac7c-5edb65086449 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:23.437641 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-80c3f879-2eea-40e4-ac7c-5edb65086449 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:23.443582 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-80c3f879-2eea-40e4-ac7c-5edb65086449 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:23.444033 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-80c3f879-2eea-40e4-ac7c-5edb65086449 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:23.444805 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-80c3f879-2eea-40e4-ac7c-5edb65086449 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:23.445279 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-80c3f879-2eea-40e4-ac7c-5edb65086449 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:23.625271 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-80c3f879-2eea-40e4-ac7c-5edb65086449 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:23.636493 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-80c3f879-2eea-40e4-ac7c-5edb65086449 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1496 microversion: 2.1 time: 0.203571 May 10 16:46:23.637257 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 104/208] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:23 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1496 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:24.109875 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c8bad141-6cce-48f7-8c61-739b4647a1ea tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:24.110540 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c8bad141-6cce-48f7-8c61-739b4647a1ea tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:24.116847 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c8bad141-6cce-48f7-8c61-739b4647a1ea tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:24.117293 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c8bad141-6cce-48f7-8c61-739b4647a1ea tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:24.118057 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c8bad141-6cce-48f7-8c61-739b4647a1ea tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:24.118488 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c8bad141-6cce-48f7-8c61-739b4647a1ea tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:24.164708 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c8bad141-6cce-48f7-8c61-739b4647a1ea tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:24.165163 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c8bad141-6cce-48f7-8c61-739b4647a1ea tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:24.165631 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-c8bad141-6cce-48f7-8c61-739b4647a1ea tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lazy-loading 'fault' on Instance uuid cbae1dbd-c3ef-4359-862c-9b73b101ef90 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:46:24.224386 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c8bad141-6cce-48f7-8c61-739b4647a1ea tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e31bed346e408e8499bcc6a3397a82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62efa049c3d42a58322385ec167719c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:24.234994 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c8bad141-6cce-48f7-8c61-739b4647a1ea tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 200 len: 1351 microversion: 2.1 time: 0.129267 May 10 16:46:24.245725 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 105/209] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:24 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 1351 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:24.396254 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-86a05292-51c5-4002-a6f4-4b40ca7193f6 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:24.396866 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-86a05292-51c5-4002-a6f4-4b40ca7193f6 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:24.404818 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-86a05292-51c5-4002-a6f4-4b40ca7193f6 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:24.405275 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-86a05292-51c5-4002-a6f4-4b40ca7193f6 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:24.406062 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-86a05292-51c5-4002-a6f4-4b40ca7193f6 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:24.406494 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-86a05292-51c5-4002-a6f4-4b40ca7193f6 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:24.573260 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-86a05292-51c5-4002-a6f4-4b40ca7193f6 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:24.581507 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-86a05292-51c5-4002-a6f4-4b40ca7193f6 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.189256 May 10 16:46:24.582239 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 105/210] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:24 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:25.252363 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2dd183a0-ef7a-4848-9add-458bf084bef1 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:25.252984 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2dd183a0-ef7a-4848-9add-458bf084bef1 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:25.258870 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2dd183a0-ef7a-4848-9add-458bf084bef1 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:25.259236 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2dd183a0-ef7a-4848-9add-458bf084bef1 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:25.260247 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2dd183a0-ef7a-4848-9add-458bf084bef1 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:25.260995 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2dd183a0-ef7a-4848-9add-458bf084bef1 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:25.275552 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-2dd183a0-ef7a-4848-9add-458bf084bef1 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] HTTP exception thrown: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2dd183a0-ef7a-4848-9add-458bf084bef1 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Request method failure captured: May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 HTTP/1.1 May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept: application/json May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Connection: close May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Host: 10.222.0.57 May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABiepaLLHvVjJEGq-IN8aiPbAtoGVVBmmkrb8vh22yWauMAO7qpDOim9nxVYcdJziO_qLDEHLRYgMpZjUv0YKMJZzccVwhmq0IiDk0L-F71ovMqSdHDpHlBzBjB75M70NmSP4z0sEelhjYW0FKVJ82qQY3zhddtW3Yd-_dZ83yWu9mWrrU May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Id: e62efa049c3d42a58322385ec167719c May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-DeleteServersTestJSON-533431304 May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 10 16:46:25.295340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 10 16:46:25.296820 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e62efa049c3d42a58322385ec167719c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e62efa049c3d42a58322385ec167719c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e62efa049c3d42a58322385ec167719c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e62efa049c3d42a58322385ec167719c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:46:25.296820 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-DeleteServersTestJSON-533431304 May 10 16:46:25.296820 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Id: e62efa049c3d42a58322385ec167719c May 10 16:46:25.296820 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-DeleteServersTestJSON-533431304 May 10 16:46:25.296820 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User: tempest-DeleteServersTestJSON-533431304-project May 10 16:46:25.296820 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 10 16:46:25.296820 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 10 16:46:25.296820 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Id: e7e31bed346e408e8499bcc6a3397a82 May 10 16:46:25.296820 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-DeleteServersTestJSON-533431304-project May 10 16:46:25.296820 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: method: > May 10 16:46:25.296820 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: exception: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:25.296820 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: action_args: {'id': 'cbae1dbd-c3ef-4359-862c-9b73b101ef90'} May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:46:25.297603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:46:25.298921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:46:25.298921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:46:25.298921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:46:25.298921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:46:25.298921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:46:25.298921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:46:25.298921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:46:25.298921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:25.298921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:46:25.298921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:46:25.298921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:46:25.298921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:46:25.298921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:46:25.298921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:46:25.298921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:46:25.298921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:46:25.298921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:25.298921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:46:25.300293 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2dd183a0-ef7a-4848-9add-458bf084bef1 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Returning 404 to user: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:46:25.300293 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2dd183a0-ef7a-4848-9add-458bf084bef1 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 404 len: 111 microversion: 2.1 time: 0.048795 May 10 16:46:25.300293 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 106/211] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:25 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:46:25.409422 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-206d837b-2a29-4d35-b5e0-4a5b5c3bc36e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:25.410417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-206d837b-2a29-4d35-b5e0-4a5b5c3bc36e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:25.416996 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-206d837b-2a29-4d35-b5e0-4a5b5c3bc36e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:25.417425 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-206d837b-2a29-4d35-b5e0-4a5b5c3bc36e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:25.418194 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-206d837b-2a29-4d35-b5e0-4a5b5c3bc36e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:25.418629 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-206d837b-2a29-4d35-b5e0-4a5b5c3bc36e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:25.438944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.wsgi [None req-206d837b-2a29-4d35-b5e0-4a5b5c3bc36e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] HTTP exception thrown: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-206d837b-2a29-4d35-b5e0-4a5b5c3bc36e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Request method failure captured: May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90/os-volume_attachments HTTP/1.1 May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 0 May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepaLLHvVjJEGq-IN8aiPbAtoGVVBmmkrb8vh22yWauMAO7qpDOim9nxVYcdJziO_qLDEHLRYgMpZjUv0YKMJZzccVwhmq0IiDk0L-F71ovMqSdHDpHlBzBjB75M70NmSP4z0sEelhjYW0FKVJ82qQY3zhddtW3Yd-_dZ83yWu9mWrrU May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: e62efa049c3d42a58322385ec167719c May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-DeleteServersTestJSON-533431304 May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:46:25.442944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:46:25.444372 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e62efa049c3d42a58322385ec167719c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e62efa049c3d42a58322385ec167719c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e62efa049c3d42a58322385ec167719c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e62efa049c3d42a58322385ec167719c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:46:25.444372 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-DeleteServersTestJSON-533431304 May 10 16:46:25.444372 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: e62efa049c3d42a58322385ec167719c May 10 16:46:25.444372 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-DeleteServersTestJSON-533431304 May 10 16:46:25.444372 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-DeleteServersTestJSON-533431304-project May 10 16:46:25.444372 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:46:25.444372 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:46:25.444372 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: e7e31bed346e408e8499bcc6a3397a82 May 10 16:46:25.444372 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-DeleteServersTestJSON-533431304-project May 10 16:46:25.444372 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: > May 10 16:46:25.444372 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:25.444372 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'server_id': 'cbae1dbd-c3ef-4359-862c-9b73b101ef90'} May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:46:25.445131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:25.446176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:46:25.447392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-206d837b-2a29-4d35-b5e0-4a5b5c3bc36e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Returning 404 to user: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:46:25.447392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-206d837b-2a29-4d35-b5e0-4a5b5c3bc36e tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038932 May 10 16:46:25.447392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 106/212] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 16:46:25 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:46:25.602664 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0702b685-92ab-4355-9efa-275095237591 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:25.603328 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0702b685-92ab-4355-9efa-275095237591 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:25.609935 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0702b685-92ab-4355-9efa-275095237591 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:25.610383 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0702b685-92ab-4355-9efa-275095237591 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:25.611180 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0702b685-92ab-4355-9efa-275095237591 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:25.611784 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0702b685-92ab-4355-9efa-275095237591 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:25.755284 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0702b685-92ab-4355-9efa-275095237591 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:25.762634 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0702b685-92ab-4355-9efa-275095237591 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.165087 May 10 16:46:25.763328 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 107/213] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:25 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:26.781967 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-6b6347b8-17c8-4da7-b6cd-c9ca464b0e6b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:26.782594 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-6b6347b8-17c8-4da7-b6cd-c9ca464b0e6b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:26.789806 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6b6347b8-17c8-4da7-b6cd-c9ca464b0e6b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:26.790257 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6b6347b8-17c8-4da7-b6cd-c9ca464b0e6b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:26.791105 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6b6347b8-17c8-4da7-b6cd-c9ca464b0e6b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:26.791540 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6b6347b8-17c8-4da7-b6cd-c9ca464b0e6b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:26.924521 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6b6347b8-17c8-4da7-b6cd-c9ca464b0e6b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:26.932401 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-6b6347b8-17c8-4da7-b6cd-c9ca464b0e6b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.154844 May 10 16:46:26.932977 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 107/214] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:26 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:27.636421 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fd11e9cf-2f58-4201-98c0-faa98d8f2643 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:27.636900 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-fd11e9cf-2f58-4201-98c0-faa98d8f2643 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:27.642709 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fd11e9cf-2f58-4201-98c0-faa98d8f2643 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:27.643184 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fd11e9cf-2f58-4201-98c0-faa98d8f2643 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:27.643966 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fd11e9cf-2f58-4201-98c0-faa98d8f2643 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:27.644397 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fd11e9cf-2f58-4201-98c0-faa98d8f2643 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:27.669471 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-fd11e9cf-2f58-4201-98c0-faa98d8f2643 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:46:27.749604 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fd11e9cf-2f58-4201-98c0-faa98d8f2643 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "DELETE /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 204 len: 0 microversion: 2.1 time: 0.116718 May 10 16:46:27.750216 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 108/215] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 16:46:27 2022] DELETE /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:46:27.758479 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-74a5bd10-b94f-42f9-abe8-13ff32963471 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:27.759134 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-74a5bd10-b94f-42f9-abe8-13ff32963471 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:27.766096 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-74a5bd10-b94f-42f9-abe8-13ff32963471 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:27.766669 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-74a5bd10-b94f-42f9-abe8-13ff32963471 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:27.767482 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-74a5bd10-b94f-42f9-abe8-13ff32963471 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:27.767910 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-74a5bd10-b94f-42f9-abe8-13ff32963471 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:27.926586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-74a5bd10-b94f-42f9-abe8-13ff32963471 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:27.934455 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-74a5bd10-b94f-42f9-abe8-13ff32963471 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1502 microversion: 2.1 time: 0.179765 May 10 16:46:27.935078 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 108/216] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:27 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1502 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:27.954534 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b5aa952a-0002-4a3e-956e-b7e24589910e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:27.954534 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b5aa952a-0002-4a3e-956e-b7e24589910e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:27.957886 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b5aa952a-0002-4a3e-956e-b7e24589910e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:27.958343 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b5aa952a-0002-4a3e-956e-b7e24589910e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:27.959221 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b5aa952a-0002-4a3e-956e-b7e24589910e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:27.959666 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b5aa952a-0002-4a3e-956e-b7e24589910e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:28.108225 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b5aa952a-0002-4a3e-956e-b7e24589910e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:28.117139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b5aa952a-0002-4a3e-956e-b7e24589910e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.170715 May 10 16:46:28.117784 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 109/217] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:27 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:28.788210 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f62089c5-6c43-4200-b8d9-aa3173b35ded tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:28.789020 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-f62089c5-6c43-4200-b8d9-aa3173b35ded tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:28.804375 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f62089c5-6c43-4200-b8d9-aa3173b35ded tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:28.806523 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f62089c5-6c43-4200-b8d9-aa3173b35ded tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:28.807658 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f62089c5-6c43-4200-b8d9-aa3173b35ded tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:28.808348 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f62089c5-6c43-4200-b8d9-aa3173b35ded tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:28.826865 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.wsgi [None req-f62089c5-6c43-4200-b8d9-aa3173b35ded tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] HTTP exception thrown: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f62089c5-6c43-4200-b8d9-aa3173b35ded tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Request method failure captured: May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: DELETE /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 HTTP/1.1 May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 0 May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepaLLHvVjJEGq-IN8aiPbAtoGVVBmmkrb8vh22yWauMAO7qpDOim9nxVYcdJziO_qLDEHLRYgMpZjUv0YKMJZzccVwhmq0IiDk0L-F71ovMqSdHDpHlBzBjB75M70NmSP4z0sEelhjYW0FKVJ82qQY3zhddtW3Yd-_dZ83yWu9mWrrU May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: e62efa049c3d42a58322385ec167719c May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-DeleteServersTestJSON-533431304 May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:46:28.829018 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:46:28.830341 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e62efa049c3d42a58322385ec167719c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e62efa049c3d42a58322385ec167719c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e62efa049c3d42a58322385ec167719c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e62efa049c3d42a58322385ec167719c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:46:28.830341 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-DeleteServersTestJSON-533431304 May 10 16:46:28.830341 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: e62efa049c3d42a58322385ec167719c May 10 16:46:28.830341 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-DeleteServersTestJSON-533431304 May 10 16:46:28.830341 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-DeleteServersTestJSON-533431304-project May 10 16:46:28.830341 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:46:28.830341 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:46:28.830341 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: e7e31bed346e408e8499bcc6a3397a82 May 10 16:46:28.830341 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-DeleteServersTestJSON-533431304-project May 10 16:46:28.830341 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: > May 10 16:46:28.830341 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:28.830341 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'id': 'cbae1dbd-c3ef-4359-862c-9b73b101ef90'} May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:46:28.831184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:28.832518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:46:28.833628 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f62089c5-6c43-4200-b8d9-aa3173b35ded tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Returning 404 to user: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:46:28.833628 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-f62089c5-6c43-4200-b8d9-aa3173b35ded tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 404 len: 111 microversion: 2.1 time: 0.049426 May 10 16:46:28.833628 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 109/218] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 16:46:28 2022] DELETE /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:46:28.839016 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-28397650-8575-4575-856b-43269a151207 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:28.839636 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-28397650-8575-4575-856b-43269a151207 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] [instance: cbae1dbd-c3ef-4359-862c-9b73b101ef90] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:28.848941 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-28397650-8575-4575-856b-43269a151207 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:28.850776 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-28397650-8575-4575-856b-43269a151207 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:28.851663 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-28397650-8575-4575-856b-43269a151207 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:28.852097 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-28397650-8575-4575-856b-43269a151207 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:28.874414 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-28397650-8575-4575-856b-43269a151207 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] HTTP exception thrown: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-28397650-8575-4575-856b-43269a151207 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Request method failure captured: May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 HTTP/1.1 May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept: application/json May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Connection: close May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Host: 10.222.0.57 May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABiepaLLHvVjJEGq-IN8aiPbAtoGVVBmmkrb8vh22yWauMAO7qpDOim9nxVYcdJziO_qLDEHLRYgMpZjUv0YKMJZzccVwhmq0IiDk0L-F71ovMqSdHDpHlBzBjB75M70NmSP4z0sEelhjYW0FKVJ82qQY3zhddtW3Yd-_dZ83yWu9mWrrU May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Id: e62efa049c3d42a58322385ec167719c May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-DeleteServersTestJSON-533431304 May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 10 16:46:28.877036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 10 16:46:28.878225 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e62efa049c3d42a58322385ec167719c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e62efa049c3d42a58322385ec167719c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e62efa049c3d42a58322385ec167719c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e62efa049c3d42a58322385ec167719c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:46:28.878225 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-DeleteServersTestJSON-533431304 May 10 16:46:28.878225 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Id: e62efa049c3d42a58322385ec167719c May 10 16:46:28.878225 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-DeleteServersTestJSON-533431304 May 10 16:46:28.878225 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User: tempest-DeleteServersTestJSON-533431304-project May 10 16:46:28.878225 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 10 16:46:28.878225 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 10 16:46:28.878225 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Id: e7e31bed346e408e8499bcc6a3397a82 May 10 16:46:28.878225 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-DeleteServersTestJSON-533431304-project May 10 16:46:28.878225 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: method: > May 10 16:46:28.878225 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: exception: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:28.878225 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: action_args: {'id': 'cbae1dbd-c3ef-4359-862c-9b73b101ef90'} May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:46:28.878872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:46:28.879967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:46:28.879967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:46:28.879967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:46:28.879967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:46:28.879967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:46:28.879967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:46:28.879967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:46:28.879967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:28.879967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:46:28.879967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:46:28.879967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:46:28.879967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:46:28.879967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:46:28.879967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:46:28.879967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:46:28.879967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:46:28.879967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. May 10 16:46:28.879967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:46:28.880961 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-28397650-8575-4575-856b-43269a151207 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] Returning 404 to user: Instance cbae1dbd-c3ef-4359-862c-9b73b101ef90 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:46:28.880961 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-28397650-8575-4575-856b-43269a151207 tempest-DeleteServersTestJSON-533431304 tempest-DeleteServersTestJSON-533431304-project] 10.222.0.57 "GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90" status: 404 len: 111 microversion: 2.1 time: 0.043242 May 10 16:46:28.880961 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 110/219] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:28 2022] GET /compute/v2.1/servers/cbae1dbd-c3ef-4359-862c-9b73b101ef90 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:46:28.952860 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-dcd96314-ebfb-46cd-a4df-0e202c3f64d4 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:28.954078 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-dcd96314-ebfb-46cd-a4df-0e202c3f64d4 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:28.960510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-dcd96314-ebfb-46cd-a4df-0e202c3f64d4 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:28.961240 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-dcd96314-ebfb-46cd-a4df-0e202c3f64d4 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:28.962226 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-dcd96314-ebfb-46cd-a4df-0e202c3f64d4 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:28.962832 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-dcd96314-ebfb-46cd-a4df-0e202c3f64d4 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:29.133549 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-30be48ec-db5e-4e75-8559-f85434ce4b85 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:29.134159 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-30be48ec-db5e-4e75-8559-f85434ce4b85 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:29.141985 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-30be48ec-db5e-4e75-8559-f85434ce4b85 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:29.142672 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-30be48ec-db5e-4e75-8559-f85434ce4b85 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:29.143899 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-30be48ec-db5e-4e75-8559-f85434ce4b85 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:29.145282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-30be48ec-db5e-4e75-8559-f85434ce4b85 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:29.189529 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-dcd96314-ebfb-46cd-a4df-0e202c3f64d4 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:29.203008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-dcd96314-ebfb-46cd-a4df-0e202c3f64d4 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1502 microversion: 2.1 time: 0.253399 May 10 16:46:29.205972 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 110/220] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:28 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1502 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:29.343503 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-30be48ec-db5e-4e75-8559-f85434ce4b85 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:29.350737 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-30be48ec-db5e-4e75-8559-f85434ce4b85 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.221048 May 10 16:46:29.351394 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 111/221] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:29 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:30.223235 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f8c66703-ac30-4641-9158-d5066f989d52 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:30.223818 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-f8c66703-ac30-4641-9158-d5066f989d52 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:30.232007 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f8c66703-ac30-4641-9158-d5066f989d52 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:30.234116 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f8c66703-ac30-4641-9158-d5066f989d52 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:30.236993 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f8c66703-ac30-4641-9158-d5066f989d52 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:30.238226 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f8c66703-ac30-4641-9158-d5066f989d52 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:30.372521 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d80687b6-e1c8-4172-83b1-cc16f51ee959 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:30.375725 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d80687b6-e1c8-4172-83b1-cc16f51ee959 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:30.390338 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d80687b6-e1c8-4172-83b1-cc16f51ee959 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:30.392077 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d80687b6-e1c8-4172-83b1-cc16f51ee959 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:30.393350 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d80687b6-e1c8-4172-83b1-cc16f51ee959 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:30.393888 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d80687b6-e1c8-4172-83b1-cc16f51ee959 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:30.551808 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f8c66703-ac30-4641-9158-d5066f989d52 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:30.582472 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-f8c66703-ac30-4641-9158-d5066f989d52 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 200 len: 1502 microversion: 2.1 time: 0.363958 May 10 16:46:30.592004 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 111/222] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:30 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 1502 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:30.601667 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-c6fb850b-41ba-4a23-9ad9-76baec556156 req-eacad3b1-fdff-4555-a099-7b8b95434352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25942336-75cc-497f-8cdf-94017ee2fee6", "name": "network-vif-deleted", "tag": "fab849a0-054d-452a-b121-5bf155a95f64"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:46:30.616173 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-c6fb850b-41ba-4a23-9ad9-76baec556156 req-eacad3b1-fdff-4555-a099-7b8b95434352 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:30.616613 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-c6fb850b-41ba-4a23-9ad9-76baec556156 req-eacad3b1-fdff-4555-a099-7b8b95434352 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:30.648175 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-c6fb850b-41ba-4a23-9ad9-76baec556156 req-eacad3b1-fdff-4555-a099-7b8b95434352 service nova] Creating event network-vif-deleted:fab849a0-054d-452a-b121-5bf155a95f64 for instance 25942336-75cc-497f-8cdf-94017ee2fee6 on hv-cinder-84130 May 10 16:46:30.657918 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-c6fb850b-41ba-4a23-9ad9-76baec556156 req-eacad3b1-fdff-4555-a099-7b8b95434352 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064637 May 10 16:46:30.660002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 112/223] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:46:30.690473 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d80687b6-e1c8-4172-83b1-cc16f51ee959 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:30.700359 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d80687b6-e1c8-4172-83b1-cc16f51ee959 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.334503 May 10 16:46:30.701436 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 112/224] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:30 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:31.610849 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-e0a2eeda-9530-480e-9322-ee953d9c7da5 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:31.611537 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-e0a2eeda-9530-480e-9322-ee953d9c7da5 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 25942336-75cc-497f-8cdf-94017ee2fee6] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:31.618228 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e0a2eeda-9530-480e-9322-ee953d9c7da5 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:31.618796 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e0a2eeda-9530-480e-9322-ee953d9c7da5 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:31.619681 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e0a2eeda-9530-480e-9322-ee953d9c7da5 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:31.620170 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e0a2eeda-9530-480e-9322-ee953d9c7da5 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:31.634656 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.wsgi [None req-e0a2eeda-9530-480e-9322-ee953d9c7da5 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] HTTP exception thrown: Instance 25942336-75cc-497f-8cdf-94017ee2fee6 could not be found. May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-e0a2eeda-9530-480e-9322-ee953d9c7da5 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Request method failure captured: May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 HTTP/1.1 May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 0 May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepbKgo1PH6bNHlYGVP9AnXYh-lNhADUNGfFZtuto-03w7SagpX3Rcwfl9BcCUuCgVGKrZB__T4Se7jywlBLZQoMYr5wvYA2B3iPjDBJndGMmlKvWytOd4RJ7EN-kB41AzgO810BAobA3ZnOfx9Uvj4rEnuUiGgtnf5h8Hep0frkNMMQ May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: afe9c1d72ca84e33b3431738acf61295 May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-VolumesActionsTest-1884457808 May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:46:31.636328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:46:31.637601 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/afe9c1d72ca84e33b3431738acf61295"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe9c1d72ca84e33b3431738acf61295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe9c1d72ca84e33b3431738acf61295"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_afe9c1d72ca84e33b3431738acf61295"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:46:31.637601 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-VolumesActionsTest-1884457808 May 10 16:46:31.637601 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: afe9c1d72ca84e33b3431738acf61295 May 10 16:46:31.637601 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-VolumesActionsTest-1884457808 May 10 16:46:31.637601 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-VolumesActionsTest-1884457808-project May 10 16:46:31.637601 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:46:31.637601 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:46:31.637601 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: 8f85454e20524acdb9d2dd01d8a71c27 May 10 16:46:31.637601 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-VolumesActionsTest-1884457808-project May 10 16:46:31.637601 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: > May 10 16:46:31.637601 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Instance 25942336-75cc-497f-8cdf-94017ee2fee6 could not be found. May 10 16:46:31.637601 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'id': '25942336-75cc-497f-8cdf-94017ee2fee6'} May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25942336-75cc-497f-8cdf-94017ee2fee6 could not be found. May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:46:31.638363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:46:31.640028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:46:31.640028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:46:31.640028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:46:31.640028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:46:31.640028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:46:31.640028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:46:31.640028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:46:31.640028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25942336-75cc-497f-8cdf-94017ee2fee6 could not be found. May 10 16:46:31.640028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:46:31.640028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:46:31.640028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:46:31.640028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:46:31.640028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:46:31.640028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:46:31.640028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:46:31.640028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:46:31.640028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25942336-75cc-497f-8cdf-94017ee2fee6 could not be found. May 10 16:46:31.640028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:46:31.641008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-e0a2eeda-9530-480e-9322-ee953d9c7da5 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Returning 404 to user: Instance 25942336-75cc-497f-8cdf-94017ee2fee6 could not be found. {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:46:31.641008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-e0a2eeda-9530-480e-9322-ee953d9c7da5 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6" status: 404 len: 111 microversion: 2.1 time: 0.032302 May 10 16:46:31.641008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 113/225] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:31 2022] GET /compute/v2.1/servers/25942336-75cc-497f-8cdf-94017ee2fee6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:46:31.720544 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0ca85de2-5d10-4c80-9484-097c826a1bcf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:31.721093 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0ca85de2-5d10-4c80-9484-097c826a1bcf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:31.728851 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0ca85de2-5d10-4c80-9484-097c826a1bcf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:31.730039 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0ca85de2-5d10-4c80-9484-097c826a1bcf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:31.731320 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0ca85de2-5d10-4c80-9484-097c826a1bcf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:31.732092 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0ca85de2-5d10-4c80-9484-097c826a1bcf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:31.784478 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-8b7abe78-2d07-474b-ad84-b1c6793a8873 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2050923538", "imageRef": "3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b", "flavorRef": "452", "networks": [{"uuid": "b40552e4-6362-447e-b70b-8f9f6a46c3b4"}]}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:46:31.853385 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.network.neutron [None req-8b7abe78-2d07-474b-ad84-b1c6793a8873 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] validate_networks() for [('b40552e4-6362-447e-b70b-8f9f6a46c3b4', None, None, None, None, None)] {{(pid=128925) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:46:32.014549 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0ca85de2-5d10-4c80-9484-097c826a1bcf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:32.033768 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0ca85de2-5d10-4c80-9484-097c826a1bcf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.319616 May 10 16:46:32.038984 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 113/226] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:31 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:32.489511 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-8b7abe78-2d07-474b-ad84-b1c6793a8873 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Flavor limits 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:46:32.490234 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-8b7abe78-2d07-474b-ad84-b1c6793a8873 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Image limits 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:46:32.491831 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-8b7abe78-2d07-474b-ad84-b1c6793a8873 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Flavor pref 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:46:32.492968 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-8b7abe78-2d07-474b-ad84-b1c6793a8873 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Image pref 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:46:32.493732 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-8b7abe78-2d07-474b-ad84-b1c6793a8873 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:46:32.512504 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8b7abe78-2d07-474b-ad84-b1c6793a8873 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:32.513274 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8b7abe78-2d07-474b-ad84-b1c6793a8873 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:32.516229 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8b7abe78-2d07-474b-ad84-b1c6793a8873 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:32.516889 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8b7abe78-2d07-474b-ad84-b1c6793a8873 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:32.545982 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-8b7abe78-2d07-474b-ad84-b1c6793a8873 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Getting quotas for project afe9c1d72ca84e33b3431738acf61295. Resources: {'instances', 'cores', 'ram'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:46:32.552315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-8b7abe78-2d07-474b-ad84-b1c6793a8873 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Getting quotas for user 8f85454e20524acdb9d2dd01d8a71c27 and project afe9c1d72ca84e33b3431738acf61295. Resources: {'instances', 'cores', 'ram'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:46:32.565231 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-8b7abe78-2d07-474b-ad84-b1c6793a8873 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Going to run 1 instances... {{(pid=128925) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:46:32.568552 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-8b7abe78-2d07-474b-ad84-b1c6793a8873 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128925) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:46:32.671441 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-8b7abe78-2d07-474b-ad84-b1c6793a8873 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.891295 May 10 16:46:32.672506 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 114/227] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 16:46:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:46:32.685237 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-72c41a17-c984-42df-87fe-06b28799640b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:32.686073 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-72c41a17-c984-42df-87fe-06b28799640b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:32.747409 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-72c41a17-c984-42df-87fe-06b28799640b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:32.755959 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-72c41a17-c984-42df-87fe-06b28799640b tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1214 microversion: 2.1 time: 0.076622 May 10 16:46:32.757187 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 114/228] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:32 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:33.058621 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-6d84bc53-b604-484c-9fd5-bf3f95a90874 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:33.059468 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-6d84bc53-b604-484c-9fd5-bf3f95a90874 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:33.086218 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6d84bc53-b604-484c-9fd5-bf3f95a90874 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:33.086707 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6d84bc53-b604-484c-9fd5-bf3f95a90874 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:33.088101 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6d84bc53-b604-484c-9fd5-bf3f95a90874 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:33.088617 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6d84bc53-b604-484c-9fd5-bf3f95a90874 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:33.271012 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6d84bc53-b604-484c-9fd5-bf3f95a90874 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:33.280137 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-6d84bc53-b604-484c-9fd5-bf3f95a90874 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.226204 May 10 16:46:33.284016 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 115/229] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:33 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:33.773689 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5d16777d-1977-4cb5-a929-6f62c3db8d8a tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:33.774872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5d16777d-1977-4cb5-a929-6f62c3db8d8a tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:33.780907 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5d16777d-1977-4cb5-a929-6f62c3db8d8a tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:33.782124 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5d16777d-1977-4cb5-a929-6f62c3db8d8a tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:33.783108 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5d16777d-1977-4cb5-a929-6f62c3db8d8a tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:33.783755 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5d16777d-1977-4cb5-a929-6f62c3db8d8a tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:33.853692 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5d16777d-1977-4cb5-a929-6f62c3db8d8a tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:33.862943 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5d16777d-1977-4cb5-a929-6f62c3db8d8a tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1266 microversion: 2.1 time: 0.093618 May 10 16:46:33.874446 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 115/230] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:33 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:34.297857 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-0ce9d3a8-d10b-4312-bae0-39c04a090106 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:34.298682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-0ce9d3a8-d10b-4312-bae0-39c04a090106 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:34.305900 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0ce9d3a8-d10b-4312-bae0-39c04a090106 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:34.306625 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0ce9d3a8-d10b-4312-bae0-39c04a090106 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:34.307618 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0ce9d3a8-d10b-4312-bae0-39c04a090106 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:34.308227 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0ce9d3a8-d10b-4312-bae0-39c04a090106 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:34.522875 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-0ce9d3a8-d10b-4312-bae0-39c04a090106 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:34.535969 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-0ce9d3a8-d10b-4312-bae0-39c04a090106 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.241869 May 10 16:46:34.536527 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 116/231] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:34 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:34.880630 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-19708d16-4319-41ec-b49c-9dac479f5a5f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:34.881244 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-19708d16-4319-41ec-b49c-9dac479f5a5f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:34.893515 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-19708d16-4319-41ec-b49c-9dac479f5a5f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:34.893967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-19708d16-4319-41ec-b49c-9dac479f5a5f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:34.896019 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-19708d16-4319-41ec-b49c-9dac479f5a5f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:34.896461 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-19708d16-4319-41ec-b49c-9dac479f5a5f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:35.378524 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-19708d16-4319-41ec-b49c-9dac479f5a5f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:35.412784 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-19708d16-4319-41ec-b49c-9dac479f5a5f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1314 microversion: 2.1 time: 0.530921 May 10 16:46:35.412784 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 116/232] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:34 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:35.554430 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-7eee8d44-7a48-4b53-ac40-3b96ef0d1c89 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:35.558995 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-7eee8d44-7a48-4b53-ac40-3b96ef0d1c89 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:35.569240 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7eee8d44-7a48-4b53-ac40-3b96ef0d1c89 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:35.570702 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7eee8d44-7a48-4b53-ac40-3b96ef0d1c89 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:35.575083 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7eee8d44-7a48-4b53-ac40-3b96ef0d1c89 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:35.575718 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7eee8d44-7a48-4b53-ac40-3b96ef0d1c89 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:35.838051 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7eee8d44-7a48-4b53-ac40-3b96ef0d1c89 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:35.857399 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-7eee8d44-7a48-4b53-ac40-3b96ef0d1c89 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.307974 May 10 16:46:35.858015 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 117/233] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:35 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:36.430772 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6af15698-89b6-47ae-88ae-ac576c4fb413 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:36.433495 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6af15698-89b6-47ae-88ae-ac576c4fb413 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:36.444583 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6af15698-89b6-47ae-88ae-ac576c4fb413 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:36.445925 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6af15698-89b6-47ae-88ae-ac576c4fb413 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:36.451433 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6af15698-89b6-47ae-88ae-ac576c4fb413 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:36.452044 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6af15698-89b6-47ae-88ae-ac576c4fb413 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:36.466030 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-a92f78b1-b7ce-47aa-9c87-69c122f535b2 req-e8e887bc-ce42-4df6-bcae-ddbc160b9d39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9", "tag": "b5816739-15d9-4118-9016-49ecda36c025"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:46:36.475388 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-a92f78b1-b7ce-47aa-9c87-69c122f535b2 req-e8e887bc-ce42-4df6-bcae-ddbc160b9d39 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:36.475994 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-a92f78b1-b7ce-47aa-9c87-69c122f535b2 req-e8e887bc-ce42-4df6-bcae-ddbc160b9d39 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:36.499592 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-a92f78b1-b7ce-47aa-9c87-69c122f535b2 req-e8e887bc-ce42-4df6-bcae-ddbc160b9d39 service nova] Creating event network-changed:b5816739-15d9-4118-9016-49ecda36c025 for instance 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 on hv-cinder-84130 May 10 16:46:36.506062 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-a92f78b1-b7ce-47aa-9c87-69c122f535b2 req-e8e887bc-ce42-4df6-bcae-ddbc160b9d39 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043683 May 10 16:46:36.507217 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 118/234] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:46:36.737062 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6af15698-89b6-47ae-88ae-ac576c4fb413 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:36.747263 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6af15698-89b6-47ae-88ae-ac576c4fb413 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1314 microversion: 2.1 time: 0.323285 May 10 16:46:36.747929 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 117/235] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:36 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:36.876129 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-3b31127f-5466-4913-953f-42ba8f7795c2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:36.878295 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-3b31127f-5466-4913-953f-42ba8f7795c2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:36.889025 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3b31127f-5466-4913-953f-42ba8f7795c2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:36.889954 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3b31127f-5466-4913-953f-42ba8f7795c2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:36.890993 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3b31127f-5466-4913-953f-42ba8f7795c2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:36.891432 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3b31127f-5466-4913-953f-42ba8f7795c2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:37.029955 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-3b31127f-5466-4913-953f-42ba8f7795c2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:37.039728 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-3b31127f-5466-4913-953f-42ba8f7795c2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.168626 May 10 16:46:37.040423 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 119/236] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:36 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:37.764519 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3bde9eaa-b905-44b2-a350-b40d4bd20567 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:37.765185 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3bde9eaa-b905-44b2-a350-b40d4bd20567 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:37.774745 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3bde9eaa-b905-44b2-a350-b40d4bd20567 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:37.775370 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3bde9eaa-b905-44b2-a350-b40d4bd20567 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:37.776897 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3bde9eaa-b905-44b2-a350-b40d4bd20567 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:37.778340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3bde9eaa-b905-44b2-a350-b40d4bd20567 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:38.063265 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-c52cf2c4-b3d5-4f30-b277-d650fb0607a3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:38.068340 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-c52cf2c4-b3d5-4f30-b277-d650fb0607a3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:38.081714 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c52cf2c4-b3d5-4f30-b277-d650fb0607a3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:38.082626 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c52cf2c4-b3d5-4f30-b277-d650fb0607a3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:38.088902 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c52cf2c4-b3d5-4f30-b277-d650fb0607a3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:38.090237 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c52cf2c4-b3d5-4f30-b277-d650fb0607a3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:38.283374 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3bde9eaa-b905-44b2-a350-b40d4bd20567 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:38.292994 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3bde9eaa-b905-44b2-a350-b40d4bd20567 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1314 microversion: 2.1 time: 0.532302 May 10 16:46:38.294532 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 118/237] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:37 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:38.415252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c52cf2c4-b3d5-4f30-b277-d650fb0607a3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:38.423009 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-c52cf2c4-b3d5-4f30-b277-d650fb0607a3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.369470 May 10 16:46:38.423607 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 120/238] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:38 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:46:39.320002 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-da0f74af-6e05-4ec7-a44e-56262b45e312 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:39.327691 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-da0f74af-6e05-4ec7-a44e-56262b45e312 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:39.355778 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da0f74af-6e05-4ec7-a44e-56262b45e312 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:39.356847 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da0f74af-6e05-4ec7-a44e-56262b45e312 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:39.358333 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da0f74af-6e05-4ec7-a44e-56262b45e312 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:39.362582 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da0f74af-6e05-4ec7-a44e-56262b45e312 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:39.441235 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-d6f37fbc-bddd-4f1c-b855-ea583a870a2a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:39.441916 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-d6f37fbc-bddd-4f1c-b855-ea583a870a2a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:39.476625 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d6f37fbc-bddd-4f1c-b855-ea583a870a2a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:39.479249 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d6f37fbc-bddd-4f1c-b855-ea583a870a2a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:39.489793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d6f37fbc-bddd-4f1c-b855-ea583a870a2a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:39.492208 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d6f37fbc-bddd-4f1c-b855-ea583a870a2a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:39.740168 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-da0f74af-6e05-4ec7-a44e-56262b45e312 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:39.750768 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-da0f74af-6e05-4ec7-a44e-56262b45e312 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1314 microversion: 2.1 time: 0.440881 May 10 16:46:39.752202 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 119/239] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:39 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:39.801533 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-d6f37fbc-bddd-4f1c-b855-ea583a870a2a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:39.815907 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-d6f37fbc-bddd-4f1c-b855-ea583a870a2a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.379112 May 10 16:46:39.817141 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 121/240] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:39 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:46:40.769071 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8bdb38bc-8bf9-4212-ab74-949c23fa3a0e tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:40.769632 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8bdb38bc-8bf9-4212-ab74-949c23fa3a0e tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:40.797007 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8bdb38bc-8bf9-4212-ab74-949c23fa3a0e tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:40.799386 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8bdb38bc-8bf9-4212-ab74-949c23fa3a0e tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:40.802193 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8bdb38bc-8bf9-4212-ab74-949c23fa3a0e tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:40.804539 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8bdb38bc-8bf9-4212-ab74-949c23fa3a0e tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:40.833255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f90e87e5-681e-42c2-9d19-f7b82732787d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:40.833999 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-f90e87e5-681e-42c2-9d19-f7b82732787d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:40.847709 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f90e87e5-681e-42c2-9d19-f7b82732787d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:40.849614 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f90e87e5-681e-42c2-9d19-f7b82732787d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:40.855193 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f90e87e5-681e-42c2-9d19-f7b82732787d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:40.863352 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f90e87e5-681e-42c2-9d19-f7b82732787d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:41.508223 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8bdb38bc-8bf9-4212-ab74-949c23fa3a0e tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:41.518193 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8bdb38bc-8bf9-4212-ab74-949c23fa3a0e tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1314 microversion: 2.1 time: 0.753919 May 10 16:46:41.530195 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 120/241] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:40 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1314 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:41.698340 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f90e87e5-681e-42c2-9d19-f7b82732787d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:41.706725 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-f90e87e5-681e-42c2-9d19-f7b82732787d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1523 microversion: 2.1 time: 0.877748 May 10 16:46:41.721745 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 122/242] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:40 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1523 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:46:42.553051 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-91119da4-8205-41de-b52d-ed85d036e34c tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:42.553987 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-91119da4-8205-41de-b52d-ed85d036e34c tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:42.571100 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-91119da4-8205-41de-b52d-ed85d036e34c tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:42.572854 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-91119da4-8205-41de-b52d-ed85d036e34c tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:42.576907 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-91119da4-8205-41de-b52d-ed85d036e34c tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:42.578878 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-91119da4-8205-41de-b52d-ed85d036e34c tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:42.726320 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-9aa2dc2f-7940-4cee-adf8-4466f8dd936c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:42.727678 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-9aa2dc2f-7940-4cee-adf8-4466f8dd936c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:42.747683 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9aa2dc2f-7940-4cee-adf8-4466f8dd936c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:42.754377 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9aa2dc2f-7940-4cee-adf8-4466f8dd936c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:42.756041 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9aa2dc2f-7940-4cee-adf8-4466f8dd936c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:42.756700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9aa2dc2f-7940-4cee-adf8-4466f8dd936c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:43.219958 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-91119da4-8205-41de-b52d-ed85d036e34c tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:43.227342 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-91119da4-8205-41de-b52d-ed85d036e34c tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1314 microversion: 2.1 time: 0.681435 May 10 16:46:43.227920 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 121/243] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:42 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:43.276515 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-9aa2dc2f-7940-4cee-adf8-4466f8dd936c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:43.286255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-9aa2dc2f-7940-4cee-adf8-4466f8dd936c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1503 microversion: 2.1 time: 0.565794 May 10 16:46:43.288853 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 123/244] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:42 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1503 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:46:43.308162 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ce1a3484-3233-4f70-8918-687491bbcb0a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:43.309170 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ce1a3484-3233-4f70-8918-687491bbcb0a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:43.318892 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ce1a3484-3233-4f70-8918-687491bbcb0a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:43.319609 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ce1a3484-3233-4f70-8918-687491bbcb0a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:43.320554 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ce1a3484-3233-4f70-8918-687491bbcb0a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:43.331764 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ce1a3484-3233-4f70-8918-687491bbcb0a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:43.661145 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ce1a3484-3233-4f70-8918-687491bbcb0a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:43.683809 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ce1a3484-3233-4f70-8918-687491bbcb0a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1517 microversion: 2.1 time: 0.379580 May 10 16:46:43.685685 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 122/245] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:43 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1517 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:44.244152 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-939fa2ea-1dc9-4318-9d9f-9874d1d31120 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:44.245487 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-939fa2ea-1dc9-4318-9d9f-9874d1d31120 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:44.258916 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-939fa2ea-1dc9-4318-9d9f-9874d1d31120 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:44.261332 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-939fa2ea-1dc9-4318-9d9f-9874d1d31120 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:44.266733 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-939fa2ea-1dc9-4318-9d9f-9874d1d31120 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:44.268048 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-939fa2ea-1dc9-4318-9d9f-9874d1d31120 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:44.776547 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-939fa2ea-1dc9-4318-9d9f-9874d1d31120 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:44.788890 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-939fa2ea-1dc9-4318-9d9f-9874d1d31120 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1314 microversion: 2.1 time: 0.547226 May 10 16:46:44.793625 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 124/246] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:44 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:45.619697 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9dd6ff39-2ff4-4729-adf5-fb0aafc18bc8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:46:45.621729 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9dd6ff39-2ff4-4729-adf5-fb0aafc18bc8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:45.636979 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9dd6ff39-2ff4-4729-adf5-fb0aafc18bc8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:45.637748 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9dd6ff39-2ff4-4729-adf5-fb0aafc18bc8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:45.638886 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9dd6ff39-2ff4-4729-adf5-fb0aafc18bc8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:45.639526 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9dd6ff39-2ff4-4729-adf5-fb0aafc18bc8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:45.681959 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-9dd6ff39-2ff4-4729-adf5-fb0aafc18bc8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lazy-loading 'flavor' on Instance uuid 7072f21c-b362-4442-9b4e-e7ad82c6ab7d {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:46:45.810283 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-392cda0f-3569-4482-9ede-08422c2cc62f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:45.811549 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-392cda0f-3569-4482-9ede-08422c2cc62f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:45.823455 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-392cda0f-3569-4482-9ede-08422c2cc62f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:45.823903 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-392cda0f-3569-4482-9ede-08422c2cc62f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:45.824689 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-392cda0f-3569-4482-9ede-08422c2cc62f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:45.825123 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-392cda0f-3569-4482-9ede-08422c2cc62f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:45.904829 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9dd6ff39-2ff4-4729-adf5-fb0aafc18bc8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "POST /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d/action" status: 200 len: 32 microversion: 2.1 time: 0.311583 May 10 16:46:45.907065 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 123/247] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 16:46:45 2022] POST /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d/action => generated 32 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 16:46:45.916821 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3b7b14b2-3d95-4ca1-8684-036e6cfbd3f7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:45.917516 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3b7b14b2-3d95-4ca1-8684-036e6cfbd3f7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:45.941621 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3b7b14b2-3d95-4ca1-8684-036e6cfbd3f7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:45.942067 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3b7b14b2-3d95-4ca1-8684-036e6cfbd3f7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:45.943753 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3b7b14b2-3d95-4ca1-8684-036e6cfbd3f7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:45.944187 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3b7b14b2-3d95-4ca1-8684-036e6cfbd3f7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:46.306635 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-392cda0f-3569-4482-9ede-08422c2cc62f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:46.318741 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-392cda0f-3569-4482-9ede-08422c2cc62f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1314 microversion: 2.1 time: 0.512887 May 10 16:46:46.319362 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 125/248] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:45 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:46:46.386734 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3b7b14b2-3d95-4ca1-8684-036e6cfbd3f7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:46.400539 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3b7b14b2-3d95-4ca1-8684-036e6cfbd3f7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.482632 May 10 16:46:46.403091 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 124/249] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:45 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:47.335134 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-114f6f8d-87cd-450d-9463-eb26f1553cbe tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:47.335775 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-114f6f8d-87cd-450d-9463-eb26f1553cbe tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:47.349846 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-114f6f8d-87cd-450d-9463-eb26f1553cbe tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:47.350479 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-114f6f8d-87cd-450d-9463-eb26f1553cbe tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:47.351236 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-114f6f8d-87cd-450d-9463-eb26f1553cbe tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:47.351676 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-114f6f8d-87cd-450d-9463-eb26f1553cbe tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:47.421618 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-092955db-e337-44e8-b0e9-15901290a029 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:47.422155 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-092955db-e337-44e8-b0e9-15901290a029 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:47.433823 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-092955db-e337-44e8-b0e9-15901290a029 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:47.434408 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-092955db-e337-44e8-b0e9-15901290a029 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:47.435631 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-092955db-e337-44e8-b0e9-15901290a029 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:47.436081 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-092955db-e337-44e8-b0e9-15901290a029 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:47.776925 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-114f6f8d-87cd-450d-9463-eb26f1553cbe tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:47.789942 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-114f6f8d-87cd-450d-9463-eb26f1553cbe tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1314 microversion: 2.1 time: 0.458859 May 10 16:46:47.796472 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 126/250] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:47 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:47.809566 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-d45576df-2750-42b8-8894-4f8e404a8e87 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:47.810286 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-d45576df-2750-42b8-8894-4f8e404a8e87 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:47.827238 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d45576df-2750-42b8-8894-4f8e404a8e87 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:47.828439 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d45576df-2750-42b8-8894-4f8e404a8e87 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:47.836419 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d45576df-2750-42b8-8894-4f8e404a8e87 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:47.844271 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d45576df-2750-42b8-8894-4f8e404a8e87 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:47.911441 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-d45576df-2750-42b8-8894-4f8e404a8e87 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/ips" status: 200 len: 152 microversion: 2.20 time: 0.108352 May 10 16:46:47.911933 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 127/251] 10.222.0.57 () {60 vars in 1288 bytes} [Tue May 10 16:46:47 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/ips => generated 152 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:46:47.929775 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-092955db-e337-44e8-b0e9-15901290a029 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:47.960470 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-092955db-e337-44e8-b0e9-15901290a029 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.543607 May 10 16:46:47.961067 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 125/252] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:47 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:46:48.813545 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f9af02d6-3864-403e-9230-570f4884f744 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:48.814114 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-f9af02d6-3864-403e-9230-570f4884f744 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:48.822394 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f9af02d6-3864-403e-9230-570f4884f744 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:48.823099 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f9af02d6-3864-403e-9230-570f4884f744 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:48.824722 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f9af02d6-3864-403e-9230-570f4884f744 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:48.825723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f9af02d6-3864-403e-9230-570f4884f744 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:48.978175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4317ee4d-0ca0-4c70-87d0-c590099aa9da tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:48.980912 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4317ee4d-0ca0-4c70-87d0-c590099aa9da tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:49.002319 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4317ee4d-0ca0-4c70-87d0-c590099aa9da tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:49.003212 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4317ee4d-0ca0-4c70-87d0-c590099aa9da tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:49.004712 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4317ee4d-0ca0-4c70-87d0-c590099aa9da tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:49.014782 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4317ee4d-0ca0-4c70-87d0-c590099aa9da tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:49.163222 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f9af02d6-3864-403e-9230-570f4884f744 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:49.171135 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-f9af02d6-3864-403e-9230-570f4884f744 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1314 microversion: 2.1 time: 0.361876 May 10 16:46:49.180161 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 128/253] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:48 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:49.246103 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4317ee4d-0ca0-4c70-87d0-c590099aa9da tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:49.267455 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4317ee4d-0ca0-4c70-87d0-c590099aa9da tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.293510 May 10 16:46:49.279354 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 126/254] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:48 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:50.204501 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-070d7869-09e6-48a6-b947-818611fb9bcd tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:50.206104 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-070d7869-09e6-48a6-b947-818611fb9bcd tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:50.231554 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-070d7869-09e6-48a6-b947-818611fb9bcd tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:50.233381 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-070d7869-09e6-48a6-b947-818611fb9bcd tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:50.238889 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-070d7869-09e6-48a6-b947-818611fb9bcd tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:50.240020 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-070d7869-09e6-48a6-b947-818611fb9bcd tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:50.287414 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7496e333-d7c5-4a48-9457-6e7737fb4e47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:50.288147 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7496e333-d7c5-4a48-9457-6e7737fb4e47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:50.305240 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7496e333-d7c5-4a48-9457-6e7737fb4e47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:50.306574 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7496e333-d7c5-4a48-9457-6e7737fb4e47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:50.310620 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7496e333-d7c5-4a48-9457-6e7737fb4e47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:50.313933 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7496e333-d7c5-4a48-9457-6e7737fb4e47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:50.779502 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7496e333-d7c5-4a48-9457-6e7737fb4e47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:50.779669 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-070d7869-09e6-48a6-b947-818611fb9bcd tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:50.792799 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7496e333-d7c5-4a48-9457-6e7737fb4e47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.511170 May 10 16:46:50.793375 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 127/255] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:50 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:50.795216 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-070d7869-09e6-48a6-b947-818611fb9bcd tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1314 microversion: 2.1 time: 0.601678 May 10 16:46:50.803446 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 129/256] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:50 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1314 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:50.883643 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-37b606ad-6f5d-4cf8-b362-460bf64a44b4 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1976290954", "imageRef": "3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b", "flavorRef": "452"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:46:50.993328 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-37b606ad-6f5d-4cf8-b362-460bf64a44b4 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] validate_networks() for None {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:46:51.532222 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-37b606ad-6f5d-4cf8-b362-460bf64a44b4 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:46:51.533365 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-37b606ad-6f5d-4cf8-b362-460bf64a44b4 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:46:51.534047 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-37b606ad-6f5d-4cf8-b362-460bf64a44b4 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:46:51.534613 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-37b606ad-6f5d-4cf8-b362-460bf64a44b4 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:46:51.535238 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-37b606ad-6f5d-4cf8-b362-460bf64a44b4 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:46:51.552009 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-37b606ad-6f5d-4cf8-b362-460bf64a44b4 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:51.552465 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-37b606ad-6f5d-4cf8-b362-460bf64a44b4 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:51.553315 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-37b606ad-6f5d-4cf8-b362-460bf64a44b4 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:51.553756 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-37b606ad-6f5d-4cf8-b362-460bf64a44b4 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:51.591531 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-37b606ad-6f5d-4cf8-b362-460bf64a44b4 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Getting quotas for project acea6fb6fa724b1eac5123649d711528. Resources: {'instances', 'cores', 'ram'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:46:51.602710 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-37b606ad-6f5d-4cf8-b362-460bf64a44b4 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Getting quotas for user 901a5e4c69f044bda6e36690489f1c29 and project acea6fb6fa724b1eac5123649d711528. Resources: {'instances', 'cores', 'ram'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:46:51.628811 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-37b606ad-6f5d-4cf8-b362-460bf64a44b4 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:46:51.633735 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-37b606ad-6f5d-4cf8-b362-460bf64a44b4 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:46:51.726134 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-c0a0d474-a13f-4957-a6a1-8d79092029aa tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:46:51.727588 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-c0a0d474-a13f-4957-a6a1-8d79092029aa tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:51.746057 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c0a0d474-a13f-4957-a6a1-8d79092029aa tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:51.747981 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c0a0d474-a13f-4957-a6a1-8d79092029aa tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:51.756368 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c0a0d474-a13f-4957-a6a1-8d79092029aa tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:51.759699 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c0a0d474-a13f-4957-a6a1-8d79092029aa tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:51.781344 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-37b606ad-6f5d-4cf8-b362-460bf64a44b4 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.902459 May 10 16:46:51.790080 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 128/257] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 16:46:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:46:51.797942 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5725cced-1e0b-40d7-a7bc-fe199354a504 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:51.803361 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5725cced-1e0b-40d7-a7bc-fe199354a504 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:51.854995 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.objects.instance [None req-c0a0d474-a13f-4957-a6a1-8d79092029aa tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lazy-loading 'flavor' on Instance uuid 82a49eb5-dff1-452f-9e73-a8a9b0c64649 {{(pid=128925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:46:52.028329 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5725cced-1e0b-40d7-a7bc-fe199354a504 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:52.037199 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5725cced-1e0b-40d7-a7bc-fe199354a504 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1215 microversion: 2.1 time: 0.245950 May 10 16:46:52.037772 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 129/258] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:51 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1215 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:52.045308 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a45875fd-35f5-4abf-a7e4-305bd9a33c83 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:52.045937 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a45875fd-35f5-4abf-a7e4-305bd9a33c83 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:52.066395 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a45875fd-35f5-4abf-a7e4-305bd9a33c83 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:52.066862 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a45875fd-35f5-4abf-a7e4-305bd9a33c83 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:52.067746 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a45875fd-35f5-4abf-a7e4-305bd9a33c83 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:52.068542 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a45875fd-35f5-4abf-a7e4-305bd9a33c83 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:52.358600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a45875fd-35f5-4abf-a7e4-305bd9a33c83 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:52.371859 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a45875fd-35f5-4abf-a7e4-305bd9a33c83 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.332846 May 10 16:46:52.373530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 130/259] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:52 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:52.379676 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b6c472c3-183a-465e-baf3-27c63e9d15b4 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:52.380291 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b6c472c3-183a-465e-baf3-27c63e9d15b4 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:52.400261 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6c472c3-183a-465e-baf3-27c63e9d15b4 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:52.400705 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6c472c3-183a-465e-baf3-27c63e9d15b4 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:52.404284 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6c472c3-183a-465e-baf3-27c63e9d15b4 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:52.406428 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6c472c3-183a-465e-baf3-27c63e9d15b4 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:52.511866 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-c0a0d474-a13f-4957-a6a1-8d79092029aa tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "POST /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/action" status: 202 len: 0 microversion: 2.20 time: 0.791775 May 10 16:46:52.520501 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 130/260] 10.222.0.57 () {62 vars in 1318 bytes} [Tue May 10 16:46:51 2022] POST /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/action => generated 0 bytes in 801 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 16:46:52.534215 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-2c49a7ec-150c-435c-8355-82bf727d453d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:52.536065 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-2c49a7ec-150c-435c-8355-82bf727d453d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:52.552780 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2c49a7ec-150c-435c-8355-82bf727d453d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:52.556307 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2c49a7ec-150c-435c-8355-82bf727d453d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:52.558603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2c49a7ec-150c-435c-8355-82bf727d453d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:52.560275 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2c49a7ec-150c-435c-8355-82bf727d453d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:52.978137 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-2c49a7ec-150c-435c-8355-82bf727d453d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:52.998851 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-2c49a7ec-150c-435c-8355-82bf727d453d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:53.001423 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-2c49a7ec-150c-435c-8355-82bf727d453d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:53.002637 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-2c49a7ec-150c-435c-8355-82bf727d453d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1724 microversion: 2.20 time: 0.480716 May 10 16:46:53.021486 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 131/261] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:46:52 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1724 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:46:53.047021 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b6c472c3-183a-465e-baf3-27c63e9d15b4 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:53.055090 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b6c472c3-183a-465e-baf3-27c63e9d15b4 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1314 microversion: 2.1 time: 0.680460 May 10 16:46:53.055659 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 131/262] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:52 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1314 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:53.071355 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1fe17303-0df9-4d46-b46a-34a77d8d479e tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:53.072138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-1fe17303-0df9-4d46-b46a-34a77d8d479e tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:53.078120 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1fe17303-0df9-4d46-b46a-34a77d8d479e tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:53.078571 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1fe17303-0df9-4d46-b46a-34a77d8d479e tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:53.079380 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1fe17303-0df9-4d46-b46a-34a77d8d479e tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:53.079816 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1fe17303-0df9-4d46-b46a-34a77d8d479e tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:53.238358 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-1fe17303-0df9-4d46-b46a-34a77d8d479e tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:53.246951 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-1fe17303-0df9-4d46-b46a-34a77d8d479e tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1211 microversion: 2.1 time: 0.187950 May 10 16:46:53.247669 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 132/263] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:53 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1211 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:53.391552 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e1acd1b4-f6a7-429b-bc1d-6e9d9c266dae tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:53.392165 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e1acd1b4-f6a7-429b-bc1d-6e9d9c266dae tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:53.406860 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e1acd1b4-f6a7-429b-bc1d-6e9d9c266dae tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:53.407447 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e1acd1b4-f6a7-429b-bc1d-6e9d9c266dae tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:53.408099 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e1acd1b4-f6a7-429b-bc1d-6e9d9c266dae tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:53.408527 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e1acd1b4-f6a7-429b-bc1d-6e9d9c266dae tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:54.028847 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-53e9851a-370d-4598-b4b3-d5c9941ec330 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:54.029451 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-53e9851a-370d-4598-b4b3-d5c9941ec330 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:54.038497 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-53e9851a-370d-4598-b4b3-d5c9941ec330 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:54.048969 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-53e9851a-370d-4598-b4b3-d5c9941ec330 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:54.051307 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-53e9851a-370d-4598-b4b3-d5c9941ec330 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:54.052037 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-53e9851a-370d-4598-b4b3-d5c9941ec330 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:54.464669 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e1acd1b4-f6a7-429b-bc1d-6e9d9c266dae tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:54.475543 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e1acd1b4-f6a7-429b-bc1d-6e9d9c266dae tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 1.088456 May 10 16:46:54.486948 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 132/264] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:53 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:54.495355 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-50f2a119-75af-4a00-9d45-cdbd62db0650 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:54.496729 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-50f2a119-75af-4a00-9d45-cdbd62db0650 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:54.505140 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-50f2a119-75af-4a00-9d45-cdbd62db0650 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:54.505891 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-50f2a119-75af-4a00-9d45-cdbd62db0650 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:54.507255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-50f2a119-75af-4a00-9d45-cdbd62db0650 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:54.507909 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-50f2a119-75af-4a00-9d45-cdbd62db0650 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:54.856950 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-53e9851a-370d-4598-b4b3-d5c9941ec330 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:54.865594 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-53e9851a-370d-4598-b4b3-d5c9941ec330 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:54.873836 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-53e9851a-370d-4598-b4b3-d5c9941ec330 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:54.877308 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-53e9851a-370d-4598-b4b3-d5c9941ec330 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1724 microversion: 2.20 time: 0.852362 May 10 16:46:54.879283 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 133/265] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:46:54 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1724 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:46:54.890766 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-9138005a-87a5-48c6-8e69-f45bec6f0438 req-13d52088-47ef-4e28-a122-b410d14f5fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9", "name": "network-vif-plugged", "status": "completed", "tag": "b5816739-15d9-4118-9016-49ecda36c025"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:46:54.923840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-9138005a-87a5-48c6-8e69-f45bec6f0438 req-13d52088-47ef-4e28-a122-b410d14f5fe8 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:54.927028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-9138005a-87a5-48c6-8e69-f45bec6f0438 req-13d52088-47ef-4e28-a122-b410d14f5fe8 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:54.945620 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-50f2a119-75af-4a00-9d45-cdbd62db0650 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:54.953318 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-50f2a119-75af-4a00-9d45-cdbd62db0650 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1314 microversion: 2.1 time: 0.463143 May 10 16:46:54.953890 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 133/266] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:54 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:54.957453 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-9138005a-87a5-48c6-8e69-f45bec6f0438 req-13d52088-47ef-4e28-a122-b410d14f5fe8 service nova] Creating event network-vif-plugged:b5816739-15d9-4118-9016-49ecda36c025 for instance 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 on hv-cinder-84130 May 10 16:46:54.963255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-9138005a-87a5-48c6-8e69-f45bec6f0438 req-13d52088-47ef-4e28-a122-b410d14f5fe8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082583 May 10 16:46:54.964636 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ccec26fd-0687-47da-ac58-e8ab7edb5530 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:54.969212 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 134/267] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:46:54.970353 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ccec26fd-0687-47da-ac58-e8ab7edb5530 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:54.989682 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ccec26fd-0687-47da-ac58-e8ab7edb5530 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:54.990511 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ccec26fd-0687-47da-ac58-e8ab7edb5530 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:54.993186 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ccec26fd-0687-47da-ac58-e8ab7edb5530 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:54.994098 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ccec26fd-0687-47da-ac58-e8ab7edb5530 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:55.090582 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ccec26fd-0687-47da-ac58-e8ab7edb5530 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:55.109347 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ccec26fd-0687-47da-ac58-e8ab7edb5530 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1273 microversion: 2.1 time: 0.148402 May 10 16:46:55.112284 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 134/268] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:54 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1273 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:55.498155 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-9a7b145d-1a71-4d5c-b030-90e68a68e197 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:55.499107 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-9a7b145d-1a71-4d5c-b030-90e68a68e197 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:55.524087 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9a7b145d-1a71-4d5c-b030-90e68a68e197 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:55.525194 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9a7b145d-1a71-4d5c-b030-90e68a68e197 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:55.526325 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9a7b145d-1a71-4d5c-b030-90e68a68e197 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:55.528360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9a7b145d-1a71-4d5c-b030-90e68a68e197 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:55.881446 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-9a7b145d-1a71-4d5c-b030-90e68a68e197 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:55.894936 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-14305a9f-7be5-4339-bba6-5f3a51ddd6ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:55.895767 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-14305a9f-7be5-4339-bba6-5f3a51ddd6ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:55.900483 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-9a7b145d-1a71-4d5c-b030-90e68a68e197 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.410089 May 10 16:46:55.901101 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 135/269] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:55 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:55.913764 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-14305a9f-7be5-4339-bba6-5f3a51ddd6ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:55.914458 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-14305a9f-7be5-4339-bba6-5f3a51ddd6ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:55.915451 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-14305a9f-7be5-4339-bba6-5f3a51ddd6ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:55.916040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-14305a9f-7be5-4339-bba6-5f3a51ddd6ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:55.974815 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-d39edafd-74f4-4987-af39-8f608ec52124 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:55.975795 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-d39edafd-74f4-4987-af39-8f608ec52124 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:55.989026 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d39edafd-74f4-4987-af39-8f608ec52124 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:55.992016 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d39edafd-74f4-4987-af39-8f608ec52124 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:55.993088 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d39edafd-74f4-4987-af39-8f608ec52124 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:55.994724 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d39edafd-74f4-4987-af39-8f608ec52124 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:56.157385 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-14305a9f-7be5-4339-bba6-5f3a51ddd6ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:56.181498 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-14305a9f-7be5-4339-bba6-5f3a51ddd6ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:56.183426 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-14305a9f-7be5-4339-bba6-5f3a51ddd6ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:56.184794 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-14305a9f-7be5-4339-bba6-5f3a51ddd6ee tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1724 microversion: 2.20 time: 0.293796 May 10 16:46:56.198156 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 135/270] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:46:55 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:46:56.206024 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-93c93135-e520-4e99-ac93-4325d7a35835 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:56.209573 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-93c93135-e520-4e99-ac93-4325d7a35835 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:56.219900 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-93c93135-e520-4e99-ac93-4325d7a35835 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:56.222556 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-93c93135-e520-4e99-ac93-4325d7a35835 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:56.226431 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-93c93135-e520-4e99-ac93-4325d7a35835 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:56.227175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-93c93135-e520-4e99-ac93-4325d7a35835 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:56.241593 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-d39edafd-74f4-4987-af39-8f608ec52124 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:56.257793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-d39edafd-74f4-4987-af39-8f608ec52124 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1314 microversion: 2.1 time: 0.282125 May 10 16:46:56.260157 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 136/271] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:55 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:56.376003 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-93c93135-e520-4e99-ac93-4325d7a35835 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:56.391513 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-93c93135-e520-4e99-ac93-4325d7a35835 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1273 microversion: 2.1 time: 0.191743 May 10 16:46:56.392306 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 136/272] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:56 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1273 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:56.787987 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-86bd8ec6-7ea6-4906-a142-e5e51740b998 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Action: 'create', calling method: .version_select at 0x7fdf19734ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-717045666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ60znNFw8L41nZMy/ljg9v6ZuYAQ3bllCu/AHD2tBDp6mfy8vO6MLYikaZZtbM7EVnZGdw32oz5RlRK1u34wkQMcQE7P3CvdIo8M7Lu7OGluPMlvE3UGMZGHB+Q37HmZw=="}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:46:56.816660 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-86bd8ec6-7ea6-4906-a142-e5e51740b998 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Getting quotas for project 84465c37c1474aa68266191586ba2953. Resources: {'key_pairs'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:46:56.824905 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-86bd8ec6-7ea6-4906-a142-e5e51740b998 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Getting quotas for user 1bc2420288964c389f6529d9ede09bd4 and project 84465c37c1474aa68266191586ba2953. Resources: {'key_pairs'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:46:56.864187 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-86bd8ec6-7ea6-4906-a142-e5e51740b998 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.305299 May 10 16:46:56.871445 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 137/273] 10.222.0.57 () {60 vars in 1158 bytes} [Tue May 10 16:46:56 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:46:56.918288 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7487dde2-fac7-4eea-b125-444368bfb4f7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:56.918882 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7487dde2-fac7-4eea-b125-444368bfb4f7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:56.929536 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7487dde2-fac7-4eea-b125-444368bfb4f7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:56.929993 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7487dde2-fac7-4eea-b125-444368bfb4f7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:56.932407 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7487dde2-fac7-4eea-b125-444368bfb4f7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:56.932935 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7487dde2-fac7-4eea-b125-444368bfb4f7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:57.203493 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-04ad6f25-db48-42f4-9030-4cbf8bfa2940 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:57.204696 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-04ad6f25-db48-42f4-9030-4cbf8bfa2940 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:57.218267 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-04ad6f25-db48-42f4-9030-4cbf8bfa2940 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:57.219019 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-04ad6f25-db48-42f4-9030-4cbf8bfa2940 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:57.219984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-04ad6f25-db48-42f4-9030-4cbf8bfa2940 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:57.220569 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-04ad6f25-db48-42f4-9030-4cbf8bfa2940 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:57.234507 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7487dde2-fac7-4eea-b125-444368bfb4f7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:57.245233 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7487dde2-fac7-4eea-b125-444368bfb4f7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.331663 May 10 16:46:57.245844 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 137/274] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:56 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:57.277264 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4b3844f2-1139-40d4-9e55-2bf5877ebf33 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:57.278954 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4b3844f2-1139-40d4-9e55-2bf5877ebf33 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:57.293192 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4b3844f2-1139-40d4-9e55-2bf5877ebf33 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:57.294449 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4b3844f2-1139-40d4-9e55-2bf5877ebf33 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:57.298631 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4b3844f2-1139-40d4-9e55-2bf5877ebf33 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:57.306102 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4b3844f2-1139-40d4-9e55-2bf5877ebf33 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:57.770099 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4b3844f2-1139-40d4-9e55-2bf5877ebf33 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:57.787390 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4b3844f2-1139-40d4-9e55-2bf5877ebf33 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1314 microversion: 2.1 time: 0.514814 May 10 16:46:57.789768 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 138/275] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:57 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:46:57.804611 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-76f17f2f-76e1-4143-9047-497034be8e02 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:57.806454 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-76f17f2f-76e1-4143-9047-497034be8e02 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:57.813138 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-04ad6f25-db48-42f4-9030-4cbf8bfa2940 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:57.818195 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-76f17f2f-76e1-4143-9047-497034be8e02 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:57.822194 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-04ad6f25-db48-42f4-9030-4cbf8bfa2940 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:57.823669 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-76f17f2f-76e1-4143-9047-497034be8e02 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:57.823822 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-04ad6f25-db48-42f4-9030-4cbf8bfa2940 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:57.824805 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-76f17f2f-76e1-4143-9047-497034be8e02 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:57.824947 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-04ad6f25-db48-42f4-9030-4cbf8bfa2940 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1724 microversion: 2.20 time: 0.626027 May 10 16:46:57.825645 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-76f17f2f-76e1-4143-9047-497034be8e02 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:57.833346 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 138/276] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:46:57 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1724 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:46:58.046416 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-76f17f2f-76e1-4143-9047-497034be8e02 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:58.054460 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-76f17f2f-76e1-4143-9047-497034be8e02 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1315 microversion: 2.1 time: 0.263522 May 10 16:46:58.060267 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 139/277] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:57 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:58.275142 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-dcaa8c1a-bb50-4bca-8e9c-e87225736e1d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:58.275729 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-dcaa8c1a-bb50-4bca-8e9c-e87225736e1d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:58.284202 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-dcaa8c1a-bb50-4bca-8e9c-e87225736e1d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:58.290833 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-dcaa8c1a-bb50-4bca-8e9c-e87225736e1d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:58.291998 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-dcaa8c1a-bb50-4bca-8e9c-e87225736e1d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:58.292603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-dcaa8c1a-bb50-4bca-8e9c-e87225736e1d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:58.515412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-dcaa8c1a-bb50-4bca-8e9c-e87225736e1d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:58.527023 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-dcaa8c1a-bb50-4bca-8e9c-e87225736e1d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.255788 May 10 16:46:58.528735 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 139/278] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:58 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:58.808739 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1b7f4302-ad23-48f1-9445-0a8bdd9b93ef tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:58.810358 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1b7f4302-ad23-48f1-9445-0a8bdd9b93ef tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:58.822541 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b7f4302-ad23-48f1-9445-0a8bdd9b93ef tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:58.823544 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b7f4302-ad23-48f1-9445-0a8bdd9b93ef tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:58.825385 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b7f4302-ad23-48f1-9445-0a8bdd9b93ef tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:58.826027 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b7f4302-ad23-48f1-9445-0a8bdd9b93ef tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:58.847909 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-a5418134-fbaa-4139-93a1-f0580f16fa2c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:58.848543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-a5418134-fbaa-4139-93a1-f0580f16fa2c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:58.857896 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a5418134-fbaa-4139-93a1-f0580f16fa2c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:58.863078 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a5418134-fbaa-4139-93a1-f0580f16fa2c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:58.864823 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a5418134-fbaa-4139-93a1-f0580f16fa2c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:58.865457 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a5418134-fbaa-4139-93a1-f0580f16fa2c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:59.127873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1b7f4302-ad23-48f1-9445-0a8bdd9b93ef tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:59.139324 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1b7f4302-ad23-48f1-9445-0a8bdd9b93ef tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1498 microversion: 2.1 time: 0.337602 May 10 16:46:59.142483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 140/279] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:58 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1498 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:59.167224 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c96b1765-6b7d-476c-b95c-b37eac7d5815 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:59.167847 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c96b1765-6b7d-476c-b95c-b37eac7d5815 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:59.198482 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c96b1765-6b7d-476c-b95c-b37eac7d5815 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:59.198931 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c96b1765-6b7d-476c-b95c-b37eac7d5815 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:59.199754 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c96b1765-6b7d-476c-b95c-b37eac7d5815 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:59.200187 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c96b1765-6b7d-476c-b95c-b37eac7d5815 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:59.313161 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-a5418134-fbaa-4139-93a1-f0580f16fa2c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:59.326149 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-a5418134-fbaa-4139-93a1-f0580f16fa2c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:59.328142 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-a5418134-fbaa-4139-93a1-f0580f16fa2c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:59.331223 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-a5418134-fbaa-4139-93a1-f0580f16fa2c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1724 microversion: 2.20 time: 0.489206 May 10 16:46:59.344572 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 140/280] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:46:58 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1724 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:46:59.496792 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c96b1765-6b7d-476c-b95c-b37eac7d5815 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:59.508675 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c96b1765-6b7d-476c-b95c-b37eac7d5815 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1315 microversion: 2.1 time: 0.360932 May 10 16:46:59.509634 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 141/281] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:59 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:46:59.549125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-9eb8001e-3da7-421e-8dbc-6f1b39b4f885 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:46:59.549868 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-9eb8001e-3da7-421e-8dbc-6f1b39b4f885 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:46:59.557870 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9eb8001e-3da7-421e-8dbc-6f1b39b4f885 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:59.563922 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9eb8001e-3da7-421e-8dbc-6f1b39b4f885 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:59.571024 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9eb8001e-3da7-421e-8dbc-6f1b39b4f885 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:59.571622 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9eb8001e-3da7-421e-8dbc-6f1b39b4f885 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:59.787849 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-ef8c146a-37ad-415b-a7fe-b1c902b1af40 req-16f76c4f-fdfc-4ea3-ae07-b4c6d669e203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e07a306-19a1-4960-8b8e-530b31f14478", "tag": "a91c6661-dc15-4ed9-aacc-1f60643c6f18"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:46:59.829517 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-ef8c146a-37ad-415b-a7fe-b1c902b1af40 req-16f76c4f-fdfc-4ea3-ae07-b4c6d669e203 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:46:59.829990 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-ef8c146a-37ad-415b-a7fe-b1c902b1af40 req-16f76c4f-fdfc-4ea3-ae07-b4c6d669e203 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:46:59.878661 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-ef8c146a-37ad-415b-a7fe-b1c902b1af40 req-16f76c4f-fdfc-4ea3-ae07-b4c6d669e203 service nova] Creating event network-changed:a91c6661-dc15-4ed9-aacc-1f60643c6f18 for instance 8e07a306-19a1-4960-8b8e-530b31f14478 on hv-cinder-84130 May 10 16:46:59.895885 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-ef8c146a-37ad-415b-a7fe-b1c902b1af40 req-16f76c4f-fdfc-4ea3-ae07-b4c6d669e203 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110526 May 10 16:46:59.898971 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 142/282] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:46:59.981538 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-9eb8001e-3da7-421e-8dbc-6f1b39b4f885 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:46:59.991626 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-9eb8001e-3da7-421e-8dbc-6f1b39b4f885 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.446570 May 10 16:47:00.001602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 141/283] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:46:59 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:00.356214 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-aaff8226-018d-4b76-bc5e-9c61df223e7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:00.357049 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-aaff8226-018d-4b76-bc5e-9c61df223e7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:00.371924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aaff8226-018d-4b76-bc5e-9c61df223e7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:00.372507 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aaff8226-018d-4b76-bc5e-9c61df223e7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:00.376690 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aaff8226-018d-4b76-bc5e-9c61df223e7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:00.379607 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aaff8226-018d-4b76-bc5e-9c61df223e7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:00.411230 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-ba538a8a-278f-4dbb-aaa1-d7d66da00c4f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:00.411855 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-ba538a8a-278f-4dbb-aaa1-d7d66da00c4f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:00.418277 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ba538a8a-278f-4dbb-aaa1-d7d66da00c4f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:00.419397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ba538a8a-278f-4dbb-aaa1-d7d66da00c4f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:00.420419 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ba538a8a-278f-4dbb-aaa1-d7d66da00c4f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:00.421592 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ba538a8a-278f-4dbb-aaa1-d7d66da00c4f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:00.494397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-ba538a8a-278f-4dbb-aaa1-d7d66da00c4f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Going to try to terminate instance {{(pid=128925) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:47:00.706936 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-ba538a8a-278f-4dbb-aaa1-d7d66da00c4f tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "DELETE /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 204 len: 0 microversion: 2.1 time: 0.300844 May 10 16:47:00.709723 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 142/284] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 16:47:00 2022] DELETE /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 16:47:00.728662 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-de1e03fa-b274-47db-8ff9-e1938388a68d tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:00.729368 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-de1e03fa-b274-47db-8ff9-e1938388a68d tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:00.747769 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-de1e03fa-b274-47db-8ff9-e1938388a68d tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:00.748622 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-de1e03fa-b274-47db-8ff9-e1938388a68d tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:00.749291 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-de1e03fa-b274-47db-8ff9-e1938388a68d tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:00.749735 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-de1e03fa-b274-47db-8ff9-e1938388a68d tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:00.861674 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-aaff8226-018d-4b76-bc5e-9c61df223e7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:00.894175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-aaff8226-018d-4b76-bc5e-9c61df223e7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:00.901360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-aaff8226-018d-4b76-bc5e-9c61df223e7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:00.902995 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-aaff8226-018d-4b76-bc5e-9c61df223e7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1724 microversion: 2.20 time: 0.551210 May 10 16:47:00.907456 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 143/285] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:00 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1724 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:00.919094 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c9e6eb43-e19f-429f-8a36-97a8c9172271 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:00.920001 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c9e6eb43-e19f-429f-8a36-97a8c9172271 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:00.932052 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c9e6eb43-e19f-429f-8a36-97a8c9172271 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:00.932798 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c9e6eb43-e19f-429f-8a36-97a8c9172271 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:00.935361 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c9e6eb43-e19f-429f-8a36-97a8c9172271 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:00.939080 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c9e6eb43-e19f-429f-8a36-97a8c9172271 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:01.219875 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-de1e03fa-b274-47db-8ff9-e1938388a68d tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:01.233009 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-de1e03fa-b274-47db-8ff9-e1938388a68d tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1315 microversion: 2.1 time: 0.517699 May 10 16:47:01.236718 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 143/286] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:00 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:01.243455 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-4f833e71-ed6c-45b7-bd32-427bc87ba924 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:01.255618 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-4f833e71-ed6c-45b7-bd32-427bc87ba924 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:01.295593 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4f833e71-ed6c-45b7-bd32-427bc87ba924 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:01.296178 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4f833e71-ed6c-45b7-bd32-427bc87ba924 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:01.297029 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4f833e71-ed6c-45b7-bd32-427bc87ba924 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:01.297477 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4f833e71-ed6c-45b7-bd32-427bc87ba924 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:01.373995 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c9e6eb43-e19f-429f-8a36-97a8c9172271 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:01.385342 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c9e6eb43-e19f-429f-8a36-97a8c9172271 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1504 microversion: 2.1 time: 0.473871 May 10 16:47:01.387869 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 144/287] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:00 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1504 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:01.535889 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-4f833e71-ed6c-45b7-bd32-427bc87ba924 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:01.543814 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-4f833e71-ed6c-45b7-bd32-427bc87ba924 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.303926 May 10 16:47:01.551088 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 144/288] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:01 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:01.613295 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d37e14a1-52f0-4681-bb9a-1b06d656d7d7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Action: 'create', calling method: .version_select at 0x7fdf1a880c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1171161426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGC+QRigi29WM7EImYJbUJ0IfZIdHpzinGIE3jYFeJR/9bMpBgyhXdRroILM8PXZIa1s7L+X+Z20nSkuPF3Zebc3dFjuR9GjIpYeL1kj85ep8wxVCPHmIl3ymXcHIu2gg=="}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:01.669759 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-d37e14a1-52f0-4681-bb9a-1b06d656d7d7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Getting quotas for project a5da35de420b4b908dde94da66c0ecd2. Resources: {'key_pairs'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:47:01.676762 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-d37e14a1-52f0-4681-bb9a-1b06d656d7d7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Getting quotas for user 97dcd026697f4ac099a2f518408b89ed and project a5da35de420b4b908dde94da66c0ecd2. Resources: {'key_pairs'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:47:01.740934 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d37e14a1-52f0-4681-bb9a-1b06d656d7d7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.341644 May 10 16:47:01.742117 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 145/289] 10.222.0.57 () {60 vars in 1158 bytes} [Tue May 10 16:47:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:47:01.932339 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-176d060c-895f-4dd8-b354-a923402147b8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:01.932953 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-176d060c-895f-4dd8-b354-a923402147b8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:01.945592 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-176d060c-895f-4dd8-b354-a923402147b8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:01.947916 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-176d060c-895f-4dd8-b354-a923402147b8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:01.950601 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-176d060c-895f-4dd8-b354-a923402147b8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:01.953856 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-176d060c-895f-4dd8-b354-a923402147b8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:02.245626 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-176d060c-895f-4dd8-b354-a923402147b8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:02.254047 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f3bb64b7-c675-4483-8200-341470095d69 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:02.254737 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f3bb64b7-c675-4483-8200-341470095d69 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:02.264551 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-176d060c-895f-4dd8-b354-a923402147b8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:02.266242 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-176d060c-895f-4dd8-b354-a923402147b8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:02.267825 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-176d060c-895f-4dd8-b354-a923402147b8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1724 microversion: 2.20 time: 0.348656 May 10 16:47:02.267954 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f3bb64b7-c675-4483-8200-341470095d69 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:02.268502 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 145/290] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:01 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1724 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:02.269866 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f3bb64b7-c675-4483-8200-341470095d69 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:02.286464 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f3bb64b7-c675-4483-8200-341470095d69 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:02.289543 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f3bb64b7-c675-4483-8200-341470095d69 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:02.407772 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f9c94347-d5f7-4581-a39c-092d7e34b4dd tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:02.408885 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-f9c94347-d5f7-4581-a39c-092d7e34b4dd tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:02.417167 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f9c94347-d5f7-4581-a39c-092d7e34b4dd tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:02.418066 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f9c94347-d5f7-4581-a39c-092d7e34b4dd tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:02.419691 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f9c94347-d5f7-4581-a39c-092d7e34b4dd tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:02.420307 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f9c94347-d5f7-4581-a39c-092d7e34b4dd tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:02.614500 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f3bb64b7-c675-4483-8200-341470095d69 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:02.638503 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f3bb64b7-c675-4483-8200-341470095d69 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1315 microversion: 2.1 time: 0.389065 May 10 16:47:02.639657 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 146/291] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:02 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:02.651270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e53d28ca-f61e-4187-af1d-19dcca043841 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:02.651886 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e53d28ca-f61e-4187-af1d-19dcca043841 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:02.668857 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e53d28ca-f61e-4187-af1d-19dcca043841 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:02.672450 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e53d28ca-f61e-4187-af1d-19dcca043841 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:02.676237 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e53d28ca-f61e-4187-af1d-19dcca043841 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:02.679988 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e53d28ca-f61e-4187-af1d-19dcca043841 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:02.788920 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f9c94347-d5f7-4581-a39c-092d7e34b4dd tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:02.798579 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-f9c94347-d5f7-4581-a39c-092d7e34b4dd tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1504 microversion: 2.1 time: 0.395295 May 10 16:47:02.802026 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 146/292] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:02 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1504 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:02.927379 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e53d28ca-f61e-4187-af1d-19dcca043841 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:02.936124 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e53d28ca-f61e-4187-af1d-19dcca043841 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.295953 May 10 16:47:02.941774 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 147/293] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:02 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:03.288798 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-bb95db29-3611-4ee6-8d24-b15ea7d91e3f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:03.289473 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-bb95db29-3611-4ee6-8d24-b15ea7d91e3f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:03.306765 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-bb95db29-3611-4ee6-8d24-b15ea7d91e3f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:03.307240 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-bb95db29-3611-4ee6-8d24-b15ea7d91e3f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:03.308032 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-bb95db29-3611-4ee6-8d24-b15ea7d91e3f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:03.308464 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-bb95db29-3611-4ee6-8d24-b15ea7d91e3f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:03.522840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-bb95db29-3611-4ee6-8d24-b15ea7d91e3f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:03.534675 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-bb95db29-3611-4ee6-8d24-b15ea7d91e3f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:03.538514 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-bb95db29-3611-4ee6-8d24-b15ea7d91e3f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:03.541932 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-bb95db29-3611-4ee6-8d24-b15ea7d91e3f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1724 microversion: 2.20 time: 0.259183 May 10 16:47:03.544095 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 147/294] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:03 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:03.656255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-afa7b816-efe9-4ab1-9485-a97477cc78f0 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:03.657890 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-afa7b816-efe9-4ab1-9485-a97477cc78f0 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:03.673951 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-afa7b816-efe9-4ab1-9485-a97477cc78f0 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:03.674589 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-afa7b816-efe9-4ab1-9485-a97477cc78f0 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:03.675820 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-afa7b816-efe9-4ab1-9485-a97477cc78f0 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:03.676253 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-afa7b816-efe9-4ab1-9485-a97477cc78f0 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:03.819222 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f48889f6-c8a0-4889-9041-4dfb01d22738 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:03.821330 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-f48889f6-c8a0-4889-9041-4dfb01d22738 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:03.836046 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f48889f6-c8a0-4889-9041-4dfb01d22738 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:03.837145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f48889f6-c8a0-4889-9041-4dfb01d22738 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:03.839371 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f48889f6-c8a0-4889-9041-4dfb01d22738 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:03.842581 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f48889f6-c8a0-4889-9041-4dfb01d22738 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:03.980176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f48889f6-c8a0-4889-9041-4dfb01d22738 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:03.988886 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-f48889f6-c8a0-4889-9041-4dfb01d22738 tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1462 microversion: 2.1 time: 0.175105 May 10 16:47:03.991095 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 148/295] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:03 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1462 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:04.000245 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-024fe4df-9e74-4eea-82c0-c1327117a6af req-1df568ca-ab8d-435f-9730-b557f2f96e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9", "name": "network-vif-deleted", "tag": "b5816739-15d9-4118-9016-49ecda36c025"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:04.013440 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-afa7b816-efe9-4ab1-9485-a97477cc78f0 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:04.019506 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-024fe4df-9e74-4eea-82c0-c1327117a6af req-1df568ca-ab8d-435f-9730-b557f2f96e98 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:04.028480 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-024fe4df-9e74-4eea-82c0-c1327117a6af req-1df568ca-ab8d-435f-9730-b557f2f96e98 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:04.029583 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-afa7b816-efe9-4ab1-9485-a97477cc78f0 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1315 microversion: 2.1 time: 0.377401 May 10 16:47:04.031400 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 148/296] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:03 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:04.039843 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d071752e-ccf8-490c-ad71-afd229f6e953 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:04.040827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d071752e-ccf8-490c-ad71-afd229f6e953 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:04.050205 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d071752e-ccf8-490c-ad71-afd229f6e953 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:04.051273 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-024fe4df-9e74-4eea-82c0-c1327117a6af req-1df568ca-ab8d-435f-9730-b557f2f96e98 service nova] Creating event network-vif-deleted:b5816739-15d9-4118-9016-49ecda36c025 for instance 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 on hv-cinder-84130 May 10 16:47:04.051650 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d071752e-ccf8-490c-ad71-afd229f6e953 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:04.052722 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d071752e-ccf8-490c-ad71-afd229f6e953 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:04.053431 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d071752e-ccf8-490c-ad71-afd229f6e953 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:04.063216 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-024fe4df-9e74-4eea-82c0-c1327117a6af req-1df568ca-ab8d-435f-9730-b557f2f96e98 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070827 May 10 16:47:04.063817 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 149/297] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:47:04.318197 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d071752e-ccf8-490c-ad71-afd229f6e953 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:04.326914 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d071752e-ccf8-490c-ad71-afd229f6e953 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.293055 May 10 16:47:04.335796 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 149/298] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:04 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:04.562705 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-7e3c905b-ac85-480c-a70e-3c652a5043f2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:04.564081 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-7e3c905b-ac85-480c-a70e-3c652a5043f2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:04.570774 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7e3c905b-ac85-480c-a70e-3c652a5043f2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:04.571447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7e3c905b-ac85-480c-a70e-3c652a5043f2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:04.572473 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7e3c905b-ac85-480c-a70e-3c652a5043f2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:04.573068 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7e3c905b-ac85-480c-a70e-3c652a5043f2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:04.810017 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7e3c905b-ac85-480c-a70e-3c652a5043f2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:04.820237 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7e3c905b-ac85-480c-a70e-3c652a5043f2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:04.829528 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7e3c905b-ac85-480c-a70e-3c652a5043f2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:04.831148 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-7e3c905b-ac85-480c-a70e-3c652a5043f2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1724 microversion: 2.20 time: 0.273091 May 10 16:47:04.832220 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 150/299] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:04 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:05.009410 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c185ec3b-7e58-4c50-a641-66f84850742d tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:05.010131 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c185ec3b-7e58-4c50-a641-66f84850742d tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:05.017781 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c185ec3b-7e58-4c50-a641-66f84850742d tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:05.018540 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c185ec3b-7e58-4c50-a641-66f84850742d tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:05.019706 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c185ec3b-7e58-4c50-a641-66f84850742d tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:05.020520 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c185ec3b-7e58-4c50-a641-66f84850742d tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:05.052000 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-08317d4b-2e94-41af-88b5-746d2207c729 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:05.052628 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-08317d4b-2e94-41af-88b5-746d2207c729 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:05.065646 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-08317d4b-2e94-41af-88b5-746d2207c729 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:05.066107 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-08317d4b-2e94-41af-88b5-746d2207c729 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:05.066573 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c185ec3b-7e58-4c50-a641-66f84850742d tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:05.068822 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-08317d4b-2e94-41af-88b5-746d2207c729 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:05.069894 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c185ec3b-7e58-4c50-a641-66f84850742d tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:05.070372 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-c185ec3b-7e58-4c50-a641-66f84850742d tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lazy-loading 'fault' on Instance uuid 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:47:05.070700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-08317d4b-2e94-41af-88b5-746d2207c729 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:05.153310 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c185ec3b-7e58-4c50-a641-66f84850742d tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f85454e20524acdb9d2dd01d8a71c27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afe9c1d72ca84e33b3431738acf61295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:05.161669 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c185ec3b-7e58-4c50-a641-66f84850742d tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 200 len: 1304 microversion: 2.1 time: 0.157148 May 10 16:47:05.167255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 150/300] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:05 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 1304 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:05.339230 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-08317d4b-2e94-41af-88b5-746d2207c729 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:05.353233 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-47e991f7-62c6-4771-b397-27aa48ff1ec3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:05.356458 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-47e991f7-62c6-4771-b397-27aa48ff1ec3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:05.366357 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-08317d4b-2e94-41af-88b5-746d2207c729 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1315 microversion: 2.1 time: 0.321991 May 10 16:47:05.367798 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-47e991f7-62c6-4771-b397-27aa48ff1ec3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:05.369372 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 151/301] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:05 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:05.370116 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-47e991f7-62c6-4771-b397-27aa48ff1ec3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:05.378586 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-47e991f7-62c6-4771-b397-27aa48ff1ec3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:05.379464 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-47e991f7-62c6-4771-b397-27aa48ff1ec3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:05.737780 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-47e991f7-62c6-4771-b397-27aa48ff1ec3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:05.754575 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-47e991f7-62c6-4771-b397-27aa48ff1ec3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.405780 May 10 16:47:05.766672 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 151/302] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:05 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:05.856451 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-70b9e4de-b2bf-446b-9bae-75574b7b5413 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:05.857496 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-70b9e4de-b2bf-446b-9bae-75574b7b5413 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:05.870485 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-70b9e4de-b2bf-446b-9bae-75574b7b5413 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:05.871761 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-70b9e4de-b2bf-446b-9bae-75574b7b5413 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:05.884728 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-70b9e4de-b2bf-446b-9bae-75574b7b5413 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:05.885186 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-70b9e4de-b2bf-446b-9bae-75574b7b5413 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:06.190220 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b69d6f88-d6fe-49bb-87fb-f461646b678a tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:06.191705 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b69d6f88-d6fe-49bb-87fb-f461646b678a tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] [instance: 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:06.194102 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-70b9e4de-b2bf-446b-9bae-75574b7b5413 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:06.204763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-70b9e4de-b2bf-446b-9bae-75574b7b5413 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:06.209362 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-70b9e4de-b2bf-446b-9bae-75574b7b5413 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:06.211734 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-70b9e4de-b2bf-446b-9bae-75574b7b5413 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1724 microversion: 2.20 time: 0.364848 May 10 16:47:06.214599 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 152/303] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:05 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1724 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:06.215166 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b69d6f88-d6fe-49bb-87fb-f461646b678a tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:06.215638 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b69d6f88-d6fe-49bb-87fb-f461646b678a tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:06.219731 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b69d6f88-d6fe-49bb-87fb-f461646b678a tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:06.220192 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b69d6f88-d6fe-49bb-87fb-f461646b678a tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:06.260107 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-b69d6f88-d6fe-49bb-87fb-f461646b678a tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] HTTP exception thrown: Instance 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 could not be found. May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b69d6f88-d6fe-49bb-87fb-f461646b678a tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Request method failure captured: May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 HTTP/1.1 May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept: application/json May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Connection: close May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Host: 10.222.0.57 May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABiepbKgo1PH6bNHlYGVP9AnXYh-lNhADUNGfFZtuto-03w7SagpX3Rcwfl9BcCUuCgVGKrZB__T4Se7jywlBLZQoMYr5wvYA2B3iPjDBJndGMmlKvWytOd4RJ7EN-kB41AzgO810BAobA3ZnOfx9Uvj4rEnuUiGgtnf5h8Hep0frkNMMQ May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Id: afe9c1d72ca84e33b3431738acf61295 May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-VolumesActionsTest-1884457808 May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 10 16:47:06.265357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 10 16:47:06.266981 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/afe9c1d72ca84e33b3431738acf61295"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe9c1d72ca84e33b3431738acf61295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/afe9c1d72ca84e33b3431738acf61295"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_afe9c1d72ca84e33b3431738acf61295"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:47:06.266981 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-VolumesActionsTest-1884457808 May 10 16:47:06.266981 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Id: afe9c1d72ca84e33b3431738acf61295 May 10 16:47:06.266981 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-VolumesActionsTest-1884457808 May 10 16:47:06.266981 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User: tempest-VolumesActionsTest-1884457808-project May 10 16:47:06.266981 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 10 16:47:06.266981 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 10 16:47:06.266981 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Id: 8f85454e20524acdb9d2dd01d8a71c27 May 10 16:47:06.266981 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-VolumesActionsTest-1884457808-project May 10 16:47:06.266981 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: method: > May 10 16:47:06.266981 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: exception: Instance 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 could not be found. May 10 16:47:06.266981 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: action_args: {'id': '64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9'} May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 could not be found. May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:47:06.267760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:47:06.268969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:47:06.268969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:47:06.268969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:47:06.268969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:47:06.268969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:47:06.268969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:47:06.268969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:47:06.268969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 could not be found. May 10 16:47:06.268969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:47:06.268969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:47:06.268969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:47:06.268969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:47:06.268969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:47:06.268969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:47:06.268969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:47:06.268969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:47:06.268969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 could not be found. May 10 16:47:06.268969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:47:06.273427 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b69d6f88-d6fe-49bb-87fb-f461646b678a tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] Returning 404 to user: Instance 64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:47:06.278563 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b69d6f88-d6fe-49bb-87fb-f461646b678a tempest-VolumesActionsTest-1884457808 tempest-VolumesActionsTest-1884457808-project] 10.222.0.57 "GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9" status: 404 len: 111 microversion: 2.1 time: 0.095469 May 10 16:47:06.283156 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 152/304] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:06 2022] GET /compute/v2.1/servers/64c94b31-2ccb-4cdd-bfdd-61fa6d4015c9 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:47:06.386937 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-7d5926ff-5691-42d1-9ec5-189d3891e7d6 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:06.387922 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-7d5926ff-5691-42d1-9ec5-189d3891e7d6 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:06.407992 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7d5926ff-5691-42d1-9ec5-189d3891e7d6 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:06.408699 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7d5926ff-5691-42d1-9ec5-189d3891e7d6 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:06.409830 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7d5926ff-5691-42d1-9ec5-189d3891e7d6 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:06.410491 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7d5926ff-5691-42d1-9ec5-189d3891e7d6 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:06.710362 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7d5926ff-5691-42d1-9ec5-189d3891e7d6 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:06.730049 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-7d5926ff-5691-42d1-9ec5-189d3891e7d6 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1315 microversion: 2.1 time: 0.348088 May 10 16:47:06.742307 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 153/305] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:06 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:06.772804 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f88876e9-fec7-4257-95a0-37b4f3603359 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:06.773424 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f88876e9-fec7-4257-95a0-37b4f3603359 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:06.791430 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f88876e9-fec7-4257-95a0-37b4f3603359 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:06.792415 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f88876e9-fec7-4257-95a0-37b4f3603359 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:06.794038 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f88876e9-fec7-4257-95a0-37b4f3603359 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:06.795052 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f88876e9-fec7-4257-95a0-37b4f3603359 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:07.151376 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f88876e9-fec7-4257-95a0-37b4f3603359 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:07.161120 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f88876e9-fec7-4257-95a0-37b4f3603359 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.391869 May 10 16:47:07.162402 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 153/306] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:06 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:07.233771 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-35028134-373f-401c-8668-2b219d7f0fb2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:07.234399 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-35028134-373f-401c-8668-2b219d7f0fb2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:07.242868 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-35028134-373f-401c-8668-2b219d7f0fb2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:07.243360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-35028134-373f-401c-8668-2b219d7f0fb2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:07.244223 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-35028134-373f-401c-8668-2b219d7f0fb2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:07.244901 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-35028134-373f-401c-8668-2b219d7f0fb2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:07.422568 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-35028134-373f-401c-8668-2b219d7f0fb2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:07.431401 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-35028134-373f-401c-8668-2b219d7f0fb2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:07.432914 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-35028134-373f-401c-8668-2b219d7f0fb2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:07.434085 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-35028134-373f-401c-8668-2b219d7f0fb2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1724 microversion: 2.20 time: 0.204969 May 10 16:47:07.434634 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 154/307] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:07 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:07.750148 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-53e19a72-3a77-492f-9da5-421b637b8af0 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:07.750773 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-53e19a72-3a77-492f-9da5-421b637b8af0 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:07.761862 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-53e19a72-3a77-492f-9da5-421b637b8af0 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:07.762315 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-53e19a72-3a77-492f-9da5-421b637b8af0 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:07.766622 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-53e19a72-3a77-492f-9da5-421b637b8af0 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:07.767336 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-53e19a72-3a77-492f-9da5-421b637b8af0 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:08.001999 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-53e19a72-3a77-492f-9da5-421b637b8af0 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:08.019504 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-53e19a72-3a77-492f-9da5-421b637b8af0 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1315 microversion: 2.1 time: 0.274374 May 10 16:47:08.024668 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 154/308] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:07 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:08.180345 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-9272754b-1340-4598-a26d-3171b88ab441 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:08.180947 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-9272754b-1340-4598-a26d-3171b88ab441 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:08.197420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9272754b-1340-4598-a26d-3171b88ab441 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:08.198308 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9272754b-1340-4598-a26d-3171b88ab441 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:08.200193 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9272754b-1340-4598-a26d-3171b88ab441 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:08.202833 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9272754b-1340-4598-a26d-3171b88ab441 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:08.457600 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-9272754b-1340-4598-a26d-3171b88ab441 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:08.464315 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5e6a4201-e470-411a-93cf-21c701469039 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:08.466447 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5e6a4201-e470-411a-93cf-21c701469039 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:08.476153 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-9272754b-1340-4598-a26d-3171b88ab441 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.298979 May 10 16:47:08.477019 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 155/309] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:08 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:08.491699 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5e6a4201-e470-411a-93cf-21c701469039 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:08.492379 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5e6a4201-e470-411a-93cf-21c701469039 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:08.493372 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5e6a4201-e470-411a-93cf-21c701469039 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:08.494006 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5e6a4201-e470-411a-93cf-21c701469039 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:08.674257 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5e6a4201-e470-411a-93cf-21c701469039 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:08.684547 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5e6a4201-e470-411a-93cf-21c701469039 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:08.687243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5e6a4201-e470-411a-93cf-21c701469039 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:08.688549 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5e6a4201-e470-411a-93cf-21c701469039 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1745 microversion: 2.20 time: 0.238546 May 10 16:47:08.689837 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 155/310] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:08 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1745 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:09.036293 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-9af819fa-f116-48a5-a8a3-2b6b6452b14b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:09.036906 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-9af819fa-f116-48a5-a8a3-2b6b6452b14b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:09.042685 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9af819fa-f116-48a5-a8a3-2b6b6452b14b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:09.043171 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9af819fa-f116-48a5-a8a3-2b6b6452b14b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:09.043936 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9af819fa-f116-48a5-a8a3-2b6b6452b14b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:09.044384 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9af819fa-f116-48a5-a8a3-2b6b6452b14b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:09.179090 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-9af819fa-f116-48a5-a8a3-2b6b6452b14b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:09.187381 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-9af819fa-f116-48a5-a8a3-2b6b6452b14b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1315 microversion: 2.1 time: 0.154886 May 10 16:47:09.187957 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 156/311] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:09 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:09.496782 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6b70f3f8-ad54-4daf-9af5-2f004bbaaf4a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:09.497571 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6b70f3f8-ad54-4daf-9af5-2f004bbaaf4a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:09.511846 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6b70f3f8-ad54-4daf-9af5-2f004bbaaf4a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:09.512291 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6b70f3f8-ad54-4daf-9af5-2f004bbaaf4a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:09.513073 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6b70f3f8-ad54-4daf-9af5-2f004bbaaf4a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:09.513691 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6b70f3f8-ad54-4daf-9af5-2f004bbaaf4a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:09.673400 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6b70f3f8-ad54-4daf-9af5-2f004bbaaf4a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:09.697160 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6b70f3f8-ad54-4daf-9af5-2f004bbaaf4a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.204622 May 10 16:47:09.699734 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 156/312] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:09 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:09.710942 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-e1d1f22f-0080-4802-be7b-eef514055140 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:09.712169 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-e1d1f22f-0080-4802-be7b-eef514055140 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:09.719816 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e1d1f22f-0080-4802-be7b-eef514055140 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:09.720545 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e1d1f22f-0080-4802-be7b-eef514055140 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:09.723184 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-9fa39aff-566b-4b31-a5e1-69e87792a928 req-6d820883-7c1d-44ca-bfb9-ba2679f73f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e07a306-19a1-4960-8b8e-530b31f14478", "name": "network-vif-plugged", "status": "completed", "tag": "a91c6661-dc15-4ed9-aacc-1f60643c6f18"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:09.723795 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e1d1f22f-0080-4802-be7b-eef514055140 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:09.724259 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e1d1f22f-0080-4802-be7b-eef514055140 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:09.735357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-9fa39aff-566b-4b31-a5e1-69e87792a928 req-6d820883-7c1d-44ca-bfb9-ba2679f73f71 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:09.735859 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-9fa39aff-566b-4b31-a5e1-69e87792a928 req-6d820883-7c1d-44ca-bfb9-ba2679f73f71 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:09.753099 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-9fa39aff-566b-4b31-a5e1-69e87792a928 req-6d820883-7c1d-44ca-bfb9-ba2679f73f71 service nova] Creating event network-vif-plugged:a91c6661-dc15-4ed9-aacc-1f60643c6f18 for instance 8e07a306-19a1-4960-8b8e-530b31f14478 on hv-cinder-84130 May 10 16:47:09.761725 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-9fa39aff-566b-4b31-a5e1-69e87792a928 req-6d820883-7c1d-44ca-bfb9-ba2679f73f71 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046922 May 10 16:47:09.762332 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 157/313] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:47:09.900401 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-e1d1f22f-0080-4802-be7b-eef514055140 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:09.908134 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-e1d1f22f-0080-4802-be7b-eef514055140 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:09.909701 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-e1d1f22f-0080-4802-be7b-eef514055140 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:09.910807 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-e1d1f22f-0080-4802-be7b-eef514055140 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1745 microversion: 2.20 time: 0.205866 May 10 16:47:09.911814 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 157/314] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:09 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1745 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:10.205750 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-58a16178-91db-46b9-81a8-5ac7d95bd4b8 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:10.206455 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-58a16178-91db-46b9-81a8-5ac7d95bd4b8 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:10.214628 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-58a16178-91db-46b9-81a8-5ac7d95bd4b8 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:10.215556 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-58a16178-91db-46b9-81a8-5ac7d95bd4b8 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:10.216830 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-58a16178-91db-46b9-81a8-5ac7d95bd4b8 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:10.217222 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-58a16178-91db-46b9-81a8-5ac7d95bd4b8 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:10.369570 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-170b8529-5d6a-4213-8718-75a10d190072 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-855370150", "imageRef": "3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b", "flavorRef": "452", "networks": [{"uuid": "6d3c4858-4172-4c48-9213-0754e535775f"}]}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:10.381062 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-58a16178-91db-46b9-81a8-5ac7d95bd4b8 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:10.388433 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-58a16178-91db-46b9-81a8-5ac7d95bd4b8 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1315 microversion: 2.1 time: 0.188068 May 10 16:47:10.388979 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 158/315] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:10 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:10.716609 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1d7429d7-2162-4a12-921a-0ab0c3f3ed79 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:10.717285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1d7429d7-2162-4a12-921a-0ab0c3f3ed79 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:10.723283 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1d7429d7-2162-4a12-921a-0ab0c3f3ed79 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:10.723728 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1d7429d7-2162-4a12-921a-0ab0c3f3ed79 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:10.724754 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1d7429d7-2162-4a12-921a-0ab0c3f3ed79 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:10.725526 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1d7429d7-2162-4a12-921a-0ab0c3f3ed79 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:10.859887 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1d7429d7-2162-4a12-921a-0ab0c3f3ed79 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:10.867226 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1d7429d7-2162-4a12-921a-0ab0c3f3ed79 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.154593 May 10 16:47:10.867784 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 159/316] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:10 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:10.930811 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-edf972e0-6af6-4f16-8693-7820726454e2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:10.931443 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-edf972e0-6af6-4f16-8693-7820726454e2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:10.937905 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-edf972e0-6af6-4f16-8693-7820726454e2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:10.938355 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-edf972e0-6af6-4f16-8693-7820726454e2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:10.939155 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-edf972e0-6af6-4f16-8693-7820726454e2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:10.939595 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-edf972e0-6af6-4f16-8693-7820726454e2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:11.067805 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-edf972e0-6af6-4f16-8693-7820726454e2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:11.075536 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-edf972e0-6af6-4f16-8693-7820726454e2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:11.077567 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-edf972e0-6af6-4f16-8693-7820726454e2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:11.078746 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-edf972e0-6af6-4f16-8693-7820726454e2 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1745 microversion: 2.20 time: 0.151896 May 10 16:47:11.079531 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 160/317] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:10 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:47:11.405732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-96f073db-6597-497a-8787-43eb64cd9ca9 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:11.406584 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-96f073db-6597-497a-8787-43eb64cd9ca9 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:11.413199 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-96f073db-6597-497a-8787-43eb64cd9ca9 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:11.414227 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-96f073db-6597-497a-8787-43eb64cd9ca9 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:11.415594 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-96f073db-6597-497a-8787-43eb64cd9ca9 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:11.416224 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-96f073db-6597-497a-8787-43eb64cd9ca9 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:11.571978 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-96f073db-6597-497a-8787-43eb64cd9ca9 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:11.581143 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-96f073db-6597-497a-8787-43eb64cd9ca9 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1315 microversion: 2.1 time: 0.179419 May 10 16:47:11.590415 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 161/318] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:11 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:11.781857 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-5ca935d9-9c2e-4094-87a0-f449e8339a62 req-7192311c-73ba-42df-91be-72e084f6b154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a49eb5-dff1-452f-9e73-a8a9b0c64649", "name": "network-vif-plugged", "status": "completed", "tag": "0e22ce60-edf0-4181-80b7-08f1d62c396b"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:11.790042 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-5ca935d9-9c2e-4094-87a0-f449e8339a62 req-7192311c-73ba-42df-91be-72e084f6b154 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:11.790427 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-5ca935d9-9c2e-4094-87a0-f449e8339a62 req-7192311c-73ba-42df-91be-72e084f6b154 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:11.802246 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-5ca935d9-9c2e-4094-87a0-f449e8339a62 req-7192311c-73ba-42df-91be-72e084f6b154 service nova] Creating event network-vif-plugged:0e22ce60-edf0-4181-80b7-08f1d62c396b for instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 on hv-cinder-84130 May 10 16:47:11.808588 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-5ca935d9-9c2e-4094-87a0-f449e8339a62 req-7192311c-73ba-42df-91be-72e084f6b154 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030176 May 10 16:47:11.809183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 162/319] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:47:11.885292 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d2844d99-6f49-413c-a0fb-16b8a85934d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:11.885987 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d2844d99-6f49-413c-a0fb-16b8a85934d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:11.892178 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d2844d99-6f49-413c-a0fb-16b8a85934d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:11.892633 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d2844d99-6f49-413c-a0fb-16b8a85934d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:11.893405 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d2844d99-6f49-413c-a0fb-16b8a85934d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:11.893844 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d2844d99-6f49-413c-a0fb-16b8a85934d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:12.030993 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d2844d99-6f49-413c-a0fb-16b8a85934d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:12.038348 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d2844d99-6f49-413c-a0fb-16b8a85934d8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.157214 May 10 16:47:12.038899 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 163/320] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:11 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:12.098129 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4fad82c6-6183-40aa-a286-18e16da752d1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:12.098672 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4fad82c6-6183-40aa-a286-18e16da752d1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:12.108854 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4fad82c6-6183-40aa-a286-18e16da752d1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:12.110937 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4fad82c6-6183-40aa-a286-18e16da752d1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:12.110937 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4fad82c6-6183-40aa-a286-18e16da752d1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:12.110937 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4fad82c6-6183-40aa-a286-18e16da752d1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:12.247589 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4fad82c6-6183-40aa-a286-18e16da752d1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:12.255625 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4fad82c6-6183-40aa-a286-18e16da752d1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:12.257452 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4fad82c6-6183-40aa-a286-18e16da752d1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:12.258613 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4fad82c6-6183-40aa-a286-18e16da752d1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1745 microversion: 2.20 time: 0.164494 May 10 16:47:12.259195 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 164/321] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:12 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:47:12.598484 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-56be789e-0e6d-46dc-8453-f58cce10951b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:12.599137 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-56be789e-0e6d-46dc-8453-f58cce10951b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:12.605837 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-56be789e-0e6d-46dc-8453-f58cce10951b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:12.606336 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-56be789e-0e6d-46dc-8453-f58cce10951b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:12.607150 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-56be789e-0e6d-46dc-8453-f58cce10951b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:12.607597 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-56be789e-0e6d-46dc-8453-f58cce10951b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:12.739372 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-56be789e-0e6d-46dc-8453-f58cce10951b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:12.746826 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-56be789e-0e6d-46dc-8453-f58cce10951b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1465 microversion: 2.1 time: 0.152157 May 10 16:47:12.747492 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 165/322] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:12 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1465 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:12.795476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-29632777-1d2f-4e5e-90b6-b531dfd0297b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:12.796079 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-29632777-1d2f-4e5e-90b6-b531dfd0297b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:12.802572 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-29632777-1d2f-4e5e-90b6-b531dfd0297b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:12.803059 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-29632777-1d2f-4e5e-90b6-b531dfd0297b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:12.803827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-29632777-1d2f-4e5e-90b6-b531dfd0297b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:12.804270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-29632777-1d2f-4e5e-90b6-b531dfd0297b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:12.833812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-29632777-1d2f-4e5e-90b6-b531dfd0297b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:47:12.927579 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-29632777-1d2f-4e5e-90b6-b531dfd0297b tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "DELETE /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 204 len: 0 microversion: 2.1 time: 0.135258 May 10 16:47:12.927823 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 166/323] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 16:47:12 2022] DELETE /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 16:47:12.935989 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-94f3f9b0-f988-46cc-b1ea-b10b220b6800 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:12.937234 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-94f3f9b0-f988-46cc-b1ea-b10b220b6800 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:12.943398 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-94f3f9b0-f988-46cc-b1ea-b10b220b6800 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:12.943846 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-94f3f9b0-f988-46cc-b1ea-b10b220b6800 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:12.944615 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-94f3f9b0-f988-46cc-b1ea-b10b220b6800 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:12.945047 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-94f3f9b0-f988-46cc-b1ea-b10b220b6800 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:13.106028 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-94f3f9b0-f988-46cc-b1ea-b10b220b6800 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:13.117460 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-94f3f9b0-f988-46cc-b1ea-b10b220b6800 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1471 microversion: 2.1 time: 0.185290 May 10 16:47:13.118052 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 167/324] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:12 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1471 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:13.122631 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7f748109-4eb0-48a9-ad63-802641fb5629 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:13.123267 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7f748109-4eb0-48a9-ad63-802641fb5629 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:13.129940 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7f748109-4eb0-48a9-ad63-802641fb5629 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:13.130386 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7f748109-4eb0-48a9-ad63-802641fb5629 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:13.131207 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7f748109-4eb0-48a9-ad63-802641fb5629 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:13.131647 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7f748109-4eb0-48a9-ad63-802641fb5629 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:13.335625 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7f748109-4eb0-48a9-ad63-802641fb5629 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:13.344761 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7f748109-4eb0-48a9-ad63-802641fb5629 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.225699 May 10 16:47:13.345711 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 168/325] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:13 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:13.350797 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3f9c1ba0-a0f0-4a65-9e6b-fdc78a67fb53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:13.351492 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3f9c1ba0-a0f0-4a65-9e6b-fdc78a67fb53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:13.368044 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3f9c1ba0-a0f0-4a65-9e6b-fdc78a67fb53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:13.368611 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3f9c1ba0-a0f0-4a65-9e6b-fdc78a67fb53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:13.369548 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3f9c1ba0-a0f0-4a65-9e6b-fdc78a67fb53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:13.370051 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3f9c1ba0-a0f0-4a65-9e6b-fdc78a67fb53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:13.522137 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3f9c1ba0-a0f0-4a65-9e6b-fdc78a67fb53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:13.530891 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3f9c1ba0-a0f0-4a65-9e6b-fdc78a67fb53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:13.532372 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3f9c1ba0-a0f0-4a65-9e6b-fdc78a67fb53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:13.533557 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3f9c1ba0-a0f0-4a65-9e6b-fdc78a67fb53 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1745 microversion: 2.20 time: 0.186867 May 10 16:47:13.534320 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 169/326] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:13 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1745 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:14.134540 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4df21e41-8460-4a72-ba04-a03ce1e797c9 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:14.135245 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4df21e41-8460-4a72-ba04-a03ce1e797c9 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:14.141031 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4df21e41-8460-4a72-ba04-a03ce1e797c9 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:14.141479 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4df21e41-8460-4a72-ba04-a03ce1e797c9 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:14.142259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4df21e41-8460-4a72-ba04-a03ce1e797c9 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:14.142685 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4df21e41-8460-4a72-ba04-a03ce1e797c9 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:14.295671 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4df21e41-8460-4a72-ba04-a03ce1e797c9 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:14.304240 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4df21e41-8460-4a72-ba04-a03ce1e797c9 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1471 microversion: 2.1 time: 0.173327 May 10 16:47:14.306532 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 170/327] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:14 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:14.362099 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d3a10517-c0ef-487a-be72-402b146462a4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:14.362646 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d3a10517-c0ef-487a-be72-402b146462a4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:14.369383 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d3a10517-c0ef-487a-be72-402b146462a4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:14.369979 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d3a10517-c0ef-487a-be72-402b146462a4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:14.370839 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d3a10517-c0ef-487a-be72-402b146462a4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:14.371344 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d3a10517-c0ef-487a-be72-402b146462a4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:14.529465 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d3a10517-c0ef-487a-be72-402b146462a4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:14.537928 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d3a10517-c0ef-487a-be72-402b146462a4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.180276 May 10 16:47:14.538499 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 171/328] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:14 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:14.551412 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3033bc27-7e96-466d-ab3d-0453e83f7ef6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:14.552236 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3033bc27-7e96-466d-ab3d-0453e83f7ef6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:14.558360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3033bc27-7e96-466d-ab3d-0453e83f7ef6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:14.558878 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3033bc27-7e96-466d-ab3d-0453e83f7ef6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:14.559767 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3033bc27-7e96-466d-ab3d-0453e83f7ef6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:14.560287 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3033bc27-7e96-466d-ab3d-0453e83f7ef6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:14.703169 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3033bc27-7e96-466d-ab3d-0453e83f7ef6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:14.711779 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3033bc27-7e96-466d-ab3d-0453e83f7ef6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:14.713408 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3033bc27-7e96-466d-ab3d-0453e83f7ef6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:14.714742 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3033bc27-7e96-466d-ab3d-0453e83f7ef6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1740 microversion: 2.20 time: 0.167518 May 10 16:47:14.715540 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 172/329] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:14 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:15.160801 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-b67de8ae-d3d1-4736-b7b3-31e533d8af32 req-d00e03c1-11de-4598-bcb4-2d1ed2ade9e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e07a306-19a1-4960-8b8e-530b31f14478", "name": "network-vif-deleted", "tag": "a91c6661-dc15-4ed9-aacc-1f60643c6f18"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:15.169270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-b67de8ae-d3d1-4736-b7b3-31e533d8af32 req-d00e03c1-11de-4598-bcb4-2d1ed2ade9e2 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:15.170014 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-b67de8ae-d3d1-4736-b7b3-31e533d8af32 req-d00e03c1-11de-4598-bcb4-2d1ed2ade9e2 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:15.182483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-b67de8ae-d3d1-4736-b7b3-31e533d8af32 req-d00e03c1-11de-4598-bcb4-2d1ed2ade9e2 service nova] Creating event network-vif-deleted:a91c6661-dc15-4ed9-aacc-1f60643c6f18 for instance 8e07a306-19a1-4960-8b8e-530b31f14478 on hv-cinder-84130 May 10 16:47:15.187959 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-b67de8ae-d3d1-4736-b7b3-31e533d8af32 req-d00e03c1-11de-4598-bcb4-2d1ed2ade9e2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030781 May 10 16:47:15.188559 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 173/330] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:47:15.325026 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b02de340-c2eb-494c-8a32-549e7491cc45 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:15.325730 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b02de340-c2eb-494c-8a32-549e7491cc45 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:15.337585 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b02de340-c2eb-494c-8a32-549e7491cc45 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:15.338033 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b02de340-c2eb-494c-8a32-549e7491cc45 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:15.339027 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b02de340-c2eb-494c-8a32-549e7491cc45 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:15.339937 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b02de340-c2eb-494c-8a32-549e7491cc45 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:15.372429 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b02de340-c2eb-494c-8a32-549e7491cc45 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:15.372820 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b02de340-c2eb-494c-8a32-549e7491cc45 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:15.373274 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-b02de340-c2eb-494c-8a32-549e7491cc45 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lazy-loading 'fault' on Instance uuid 8e07a306-19a1-4960-8b8e-530b31f14478 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:47:15.423196 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b02de340-c2eb-494c-8a32-549e7491cc45 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '901a5e4c69f044bda6e36690489f1c29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acea6fb6fa724b1eac5123649d711528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:15.430979 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b02de340-c2eb-494c-8a32-549e7491cc45 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 200 len: 1305 microversion: 2.1 time: 0.110135 May 10 16:47:15.431561 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 174/331] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:15 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:15.554564 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a45624c0-d0f0-42d4-843a-dcffdfd11b9e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:15.555318 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a45624c0-d0f0-42d4-843a-dcffdfd11b9e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:15.562118 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a45624c0-d0f0-42d4-843a-dcffdfd11b9e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:15.562580 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a45624c0-d0f0-42d4-843a-dcffdfd11b9e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:15.563405 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a45624c0-d0f0-42d4-843a-dcffdfd11b9e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:15.563849 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a45624c0-d0f0-42d4-843a-dcffdfd11b9e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:15.704819 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a45624c0-d0f0-42d4-843a-dcffdfd11b9e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:15.712251 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a45624c0-d0f0-42d4-843a-dcffdfd11b9e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.161699 May 10 16:47:15.713113 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 175/332] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:15 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:15.737192 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-cfc5f3bc-de01-457e-ab1d-eaa10ff3c407 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:15.738101 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-cfc5f3bc-de01-457e-ab1d-eaa10ff3c407 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:15.744749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cfc5f3bc-de01-457e-ab1d-eaa10ff3c407 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:15.745106 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cfc5f3bc-de01-457e-ab1d-eaa10ff3c407 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:15.746145 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cfc5f3bc-de01-457e-ab1d-eaa10ff3c407 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:15.746622 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cfc5f3bc-de01-457e-ab1d-eaa10ff3c407 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:15.888164 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-cfc5f3bc-de01-457e-ab1d-eaa10ff3c407 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:15.896584 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-cfc5f3bc-de01-457e-ab1d-eaa10ff3c407 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:15.898459 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-cfc5f3bc-de01-457e-ab1d-eaa10ff3c407 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:15.900128 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-cfc5f3bc-de01-457e-ab1d-eaa10ff3c407 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1740 microversion: 2.20 time: 0.170064 May 10 16:47:15.900744 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 176/333] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:15 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:47:16.448871 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0a60381a-5ce8-4f7e-b88e-4e7f07720515 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:16.449717 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0a60381a-5ce8-4f7e-b88e-4e7f07720515 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] [instance: 8e07a306-19a1-4960-8b8e-530b31f14478] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:16.456191 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0a60381a-5ce8-4f7e-b88e-4e7f07720515 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:16.456644 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0a60381a-5ce8-4f7e-b88e-4e7f07720515 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:16.457417 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0a60381a-5ce8-4f7e-b88e-4e7f07720515 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:16.457855 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0a60381a-5ce8-4f7e-b88e-4e7f07720515 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:16.472654 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-0a60381a-5ce8-4f7e-b88e-4e7f07720515 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] HTTP exception thrown: Instance 8e07a306-19a1-4960-8b8e-530b31f14478 could not be found. May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0a60381a-5ce8-4f7e-b88e-4e7f07720515 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Request method failure captured: May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 HTTP/1.1 May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept: application/json May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Connection: close May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Host: 10.222.0.57 May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABiepb3iLUgJYdCRQbtpqoiaD3HJoqmEjHYL2TQwYll_kxxKFeNBONYjJioXnmKcNNIzAsmYOrzn_ofDbk2Utvf2fSkDmFaxA3hzViqGanwKbWzU4VrNPSKTcwMCtDddoZkgf4_dUtXGJg88mduPqw2Q0clvzUwTW26si4dT6d6ZVtgWbs May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Id: acea6fb6fa724b1eac5123649d711528 May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-VolumesNegativeTest-1378102715 May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 10 16:47:16.474307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 10 16:47:16.475903 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/acea6fb6fa724b1eac5123649d711528"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/acea6fb6fa724b1eac5123649d711528"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/acea6fb6fa724b1eac5123649d711528"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_acea6fb6fa724b1eac5123649d711528"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:47:16.475903 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-VolumesNegativeTest-1378102715 May 10 16:47:16.475903 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Id: acea6fb6fa724b1eac5123649d711528 May 10 16:47:16.475903 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-VolumesNegativeTest-1378102715 May 10 16:47:16.475903 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User: tempest-VolumesNegativeTest-1378102715-project May 10 16:47:16.475903 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 10 16:47:16.475903 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 10 16:47:16.475903 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Id: 901a5e4c69f044bda6e36690489f1c29 May 10 16:47:16.475903 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-VolumesNegativeTest-1378102715-project May 10 16:47:16.475903 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: method: > May 10 16:47:16.475903 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: exception: Instance 8e07a306-19a1-4960-8b8e-530b31f14478 could not be found. May 10 16:47:16.475903 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: action_args: {'id': '8e07a306-19a1-4960-8b8e-530b31f14478'} May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e07a306-19a1-4960-8b8e-530b31f14478 could not be found. May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:47:16.476807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:47:16.478285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:47:16.478285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:47:16.478285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:47:16.478285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:47:16.478285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:47:16.478285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:47:16.478285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:47:16.478285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e07a306-19a1-4960-8b8e-530b31f14478 could not be found. May 10 16:47:16.478285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:47:16.478285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:47:16.478285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:47:16.478285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:47:16.478285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:47:16.478285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:47:16.478285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:47:16.478285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:47:16.478285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e07a306-19a1-4960-8b8e-530b31f14478 could not be found. May 10 16:47:16.478285 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:47:16.479527 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0a60381a-5ce8-4f7e-b88e-4e7f07720515 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] Returning 404 to user: Instance 8e07a306-19a1-4960-8b8e-530b31f14478 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:47:16.479527 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0a60381a-5ce8-4f7e-b88e-4e7f07720515 tempest-VolumesNegativeTest-1378102715 tempest-VolumesNegativeTest-1378102715-project] 10.222.0.57 "GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478" status: 404 len: 111 microversion: 2.1 time: 0.030797 May 10 16:47:16.480969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 177/334] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:16 2022] GET /compute/v2.1/servers/8e07a306-19a1-4960-8b8e-530b31f14478 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 16:47:16.729657 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1cbf0b6a-16ea-4d51-b87a-c03ede20ec00 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:16.730429 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1cbf0b6a-16ea-4d51-b87a-c03ede20ec00 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:16.736934 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1cbf0b6a-16ea-4d51-b87a-c03ede20ec00 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:16.737451 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1cbf0b6a-16ea-4d51-b87a-c03ede20ec00 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:16.738284 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1cbf0b6a-16ea-4d51-b87a-c03ede20ec00 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:16.738809 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1cbf0b6a-16ea-4d51-b87a-c03ede20ec00 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:16.915512 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1cbf0b6a-16ea-4d51-b87a-c03ede20ec00 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:16.926231 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1cbf0b6a-16ea-4d51-b87a-c03ede20ec00 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.199879 May 10 16:47:16.927086 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 178/335] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:16 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:16.931971 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9c37ba62-bc87-4f36-b665-2118150203a7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:16.932757 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9c37ba62-bc87-4f36-b665-2118150203a7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:16.940783 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9c37ba62-bc87-4f36-b665-2118150203a7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:16.941281 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9c37ba62-bc87-4f36-b665-2118150203a7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:16.942306 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9c37ba62-bc87-4f36-b665-2118150203a7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:16.942786 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9c37ba62-bc87-4f36-b665-2118150203a7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:17.077624 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9c37ba62-bc87-4f36-b665-2118150203a7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:17.085488 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9c37ba62-bc87-4f36-b665-2118150203a7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:17.087098 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9c37ba62-bc87-4f36-b665-2118150203a7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:17.088311 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9c37ba62-bc87-4f36-b665-2118150203a7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1740 microversion: 2.20 time: 0.160157 May 10 16:47:17.088932 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 179/336] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:16 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:17.753964 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.network.neutron [None req-170b8529-5d6a-4213-8718-75a10d190072 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] validate_networks() for [('6d3c4858-4172-4c48-9213-0754e535775f', None, None, None, None, None)] {{(pid=128925) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:47:17.942878 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c69a3f31-b000-44e0-b326-f15ad9aa93e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:17.943725 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c69a3f31-b000-44e0-b326-f15ad9aa93e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:17.958458 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c69a3f31-b000-44e0-b326-f15ad9aa93e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:17.959044 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c69a3f31-b000-44e0-b326-f15ad9aa93e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:17.959909 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c69a3f31-b000-44e0-b326-f15ad9aa93e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:17.960421 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c69a3f31-b000-44e0-b326-f15ad9aa93e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:18.283909 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c69a3f31-b000-44e0-b326-f15ad9aa93e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:18.292313 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c69a3f31-b000-44e0-b326-f15ad9aa93e0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.353237 May 10 16:47:18.292887 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 180/337] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:17 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:18.297687 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7a5d5d69-4630-4ffa-b5ea-8ad934d1d7ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:18.298518 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7a5d5d69-4630-4ffa-b5ea-8ad934d1d7ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:18.306393 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7a5d5d69-4630-4ffa-b5ea-8ad934d1d7ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:18.306845 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7a5d5d69-4630-4ffa-b5ea-8ad934d1d7ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:18.307679 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7a5d5d69-4630-4ffa-b5ea-8ad934d1d7ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:18.308115 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7a5d5d69-4630-4ffa-b5ea-8ad934d1d7ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:18.621902 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7a5d5d69-4630-4ffa-b5ea-8ad934d1d7ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:18.642224 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7a5d5d69-4630-4ffa-b5ea-8ad934d1d7ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:18.644315 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7a5d5d69-4630-4ffa-b5ea-8ad934d1d7ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:18.645505 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7a5d5d69-4630-4ffa-b5ea-8ad934d1d7ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1740 microversion: 2.20 time: 0.351503 May 10 16:47:18.646071 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 181/338] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:18 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1740 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:18.738510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-170b8529-5d6a-4213-8718-75a10d190072 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Flavor limits 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:47:18.738727 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-170b8529-5d6a-4213-8718-75a10d190072 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Image limits 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:47:18.739136 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-170b8529-5d6a-4213-8718-75a10d190072 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Flavor pref 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:47:18.739573 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-170b8529-5d6a-4213-8718-75a10d190072 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Image pref 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:47:18.739979 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-170b8529-5d6a-4213-8718-75a10d190072 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:47:18.759271 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-170b8529-5d6a-4213-8718-75a10d190072 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:18.759835 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-170b8529-5d6a-4213-8718-75a10d190072 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:18.762152 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-170b8529-5d6a-4213-8718-75a10d190072 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:18.762301 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-170b8529-5d6a-4213-8718-75a10d190072 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:18.784731 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-170b8529-5d6a-4213-8718-75a10d190072 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Getting quotas for project aae4278fddbd44cbb508e4fa63f9f7a4. Resources: {'instances', 'cores', 'ram'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:47:18.789220 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-170b8529-5d6a-4213-8718-75a10d190072 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Getting quotas for user 80f1e7854604414e8174b87e039ef401 and project aae4278fddbd44cbb508e4fa63f9f7a4. Resources: {'instances', 'cores', 'ram'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:47:18.801605 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-170b8529-5d6a-4213-8718-75a10d190072 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Going to run 1 instances... {{(pid=128925) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:47:18.803966 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-170b8529-5d6a-4213-8718-75a10d190072 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128925) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:47:18.858868 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-170b8529-5d6a-4213-8718-75a10d190072 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.493246 May 10 16:47:18.864406 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 158/339] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 16:47:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 8495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 16:47:18.870116 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0b510958-b2ec-4fe9-86be-94ae902cf8f2 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:18.870955 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0b510958-b2ec-4fe9-86be-94ae902cf8f2 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:18.955909 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0b510958-b2ec-4fe9-86be-94ae902cf8f2 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:18.963874 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0b510958-b2ec-4fe9-86be-94ae902cf8f2 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1218 microversion: 2.1 time: 0.098030 May 10 16:47:18.965416 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 182/340] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:18 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:19.314292 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-42143361-fcba-49df-897b-8f98e12bb53f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:19.314953 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-42143361-fcba-49df-897b-8f98e12bb53f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:19.331408 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-42143361-fcba-49df-897b-8f98e12bb53f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:19.331845 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-42143361-fcba-49df-897b-8f98e12bb53f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:19.332692 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-42143361-fcba-49df-897b-8f98e12bb53f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:19.333128 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-42143361-fcba-49df-897b-8f98e12bb53f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:19.505422 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-42143361-fcba-49df-897b-8f98e12bb53f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:19.513217 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-42143361-fcba-49df-897b-8f98e12bb53f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.204479 May 10 16:47:19.513874 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 159/341] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:19 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:19.667589 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8d0686f8-2669-41f5-bf91-a1bcc317eded tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:19.668407 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8d0686f8-2669-41f5-bf91-a1bcc317eded tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:19.675497 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8d0686f8-2669-41f5-bf91-a1bcc317eded tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:19.676280 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8d0686f8-2669-41f5-bf91-a1bcc317eded tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:19.677127 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8d0686f8-2669-41f5-bf91-a1bcc317eded tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:19.677676 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8d0686f8-2669-41f5-bf91-a1bcc317eded tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:19.855216 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8d0686f8-2669-41f5-bf91-a1bcc317eded tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:19.868295 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8d0686f8-2669-41f5-bf91-a1bcc317eded tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:19.870522 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8d0686f8-2669-41f5-bf91-a1bcc317eded tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:19.871867 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8d0686f8-2669-41f5-bf91-a1bcc317eded tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1740 microversion: 2.20 time: 0.211989 May 10 16:47:19.872746 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 183/342] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:19 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:19.981502 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-d1b45718-16fa-40b7-9b11-4135dbad0d11 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:19.983633 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-d1b45718-16fa-40b7-9b11-4135dbad0d11 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:19.991298 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d1b45718-16fa-40b7-9b11-4135dbad0d11 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:19.991745 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d1b45718-16fa-40b7-9b11-4135dbad0d11 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:19.992544 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d1b45718-16fa-40b7-9b11-4135dbad0d11 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:19.993059 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d1b45718-16fa-40b7-9b11-4135dbad0d11 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:20.068741 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-d1b45718-16fa-40b7-9b11-4135dbad0d11 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:20.076228 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-d1b45718-16fa-40b7-9b11-4135dbad0d11 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1222 microversion: 2.1 time: 0.098564 May 10 16:47:20.076973 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 160/343] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:19 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:20.529507 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-07540a5e-6fb8-44e8-956c-e145d9857bd9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:20.531034 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-07540a5e-6fb8-44e8-956c-e145d9857bd9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:20.545288 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-07540a5e-6fb8-44e8-956c-e145d9857bd9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:20.546123 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-07540a5e-6fb8-44e8-956c-e145d9857bd9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:20.547147 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-07540a5e-6fb8-44e8-956c-e145d9857bd9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:20.547800 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-07540a5e-6fb8-44e8-956c-e145d9857bd9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:20.723027 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-07540a5e-6fb8-44e8-956c-e145d9857bd9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:20.732225 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-07540a5e-6fb8-44e8-956c-e145d9857bd9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.206531 May 10 16:47:20.732926 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 184/344] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:20 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:20.894815 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-bb5db10b-4af3-494c-b8bd-afc4843f170c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:20.896403 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-bb5db10b-4af3-494c-b8bd-afc4843f170c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:20.903847 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-bb5db10b-4af3-494c-b8bd-afc4843f170c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:20.904874 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-bb5db10b-4af3-494c-b8bd-afc4843f170c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:20.906083 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-bb5db10b-4af3-494c-b8bd-afc4843f170c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:20.906663 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-bb5db10b-4af3-494c-b8bd-afc4843f170c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:21.070182 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-bb5db10b-4af3-494c-b8bd-afc4843f170c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:21.081556 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-bb5db10b-4af3-494c-b8bd-afc4843f170c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:21.083104 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-bb5db10b-4af3-494c-b8bd-afc4843f170c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:21.084345 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-bb5db10b-4af3-494c-b8bd-afc4843f170c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1740 microversion: 2.20 time: 0.195276 May 10 16:47:21.084803 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 161/345] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:20 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:21.093887 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c9763791-d55d-4c07-bd58-fa3ad13b8d46 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:21.095504 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c9763791-d55d-4c07-bd58-fa3ad13b8d46 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:21.104235 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c9763791-d55d-4c07-bd58-fa3ad13b8d46 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:21.104679 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c9763791-d55d-4c07-bd58-fa3ad13b8d46 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:21.105450 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c9763791-d55d-4c07-bd58-fa3ad13b8d46 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:21.105883 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c9763791-d55d-4c07-bd58-fa3ad13b8d46 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:21.176014 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c9763791-d55d-4c07-bd58-fa3ad13b8d46 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:21.183611 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c9763791-d55d-4c07-bd58-fa3ad13b8d46 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1222 microversion: 2.1 time: 0.094722 May 10 16:47:21.184199 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 185/346] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:21 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:21.750353 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f55790cd-c486-4e03-88d8-829fa5e51a7f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:21.751658 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-f55790cd-c486-4e03-88d8-829fa5e51a7f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:21.757906 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f55790cd-c486-4e03-88d8-829fa5e51a7f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:21.758554 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f55790cd-c486-4e03-88d8-829fa5e51a7f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:21.759541 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f55790cd-c486-4e03-88d8-829fa5e51a7f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:21.760133 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f55790cd-c486-4e03-88d8-829fa5e51a7f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:21.947830 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f55790cd-c486-4e03-88d8-829fa5e51a7f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:21.972173 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-f55790cd-c486-4e03-88d8-829fa5e51a7f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.216663 May 10 16:47:21.979260 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 162/347] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:21 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:22.102507 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-55fbb10c-322e-4790-a614-d8aba540e475 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:22.103251 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-55fbb10c-322e-4790-a614-d8aba540e475 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:22.109490 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-55fbb10c-322e-4790-a614-d8aba540e475 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:22.109941 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-55fbb10c-322e-4790-a614-d8aba540e475 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:22.110719 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-55fbb10c-322e-4790-a614-d8aba540e475 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:22.111307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-55fbb10c-322e-4790-a614-d8aba540e475 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:22.201214 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-618553a4-2c36-4f71-972e-41039fd6c6a6 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:22.202616 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-618553a4-2c36-4f71-972e-41039fd6c6a6 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:22.211276 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-618553a4-2c36-4f71-972e-41039fd6c6a6 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:22.211886 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-618553a4-2c36-4f71-972e-41039fd6c6a6 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:22.212933 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-618553a4-2c36-4f71-972e-41039fd6c6a6 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:22.213500 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-618553a4-2c36-4f71-972e-41039fd6c6a6 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:22.289059 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-618553a4-2c36-4f71-972e-41039fd6c6a6 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:22.293100 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-55fbb10c-322e-4790-a614-d8aba540e475 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:22.308672 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-55fbb10c-322e-4790-a614-d8aba540e475 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:22.309742 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-618553a4-2c36-4f71-972e-41039fd6c6a6 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1270 microversion: 2.1 time: 0.112270 May 10 16:47:22.310444 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 163/348] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:22 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1270 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:22.323707 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-55fbb10c-322e-4790-a614-d8aba540e475 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:22.325405 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-55fbb10c-322e-4790-a614-d8aba540e475 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1740 microversion: 2.20 time: 0.227731 May 10 16:47:22.339624 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 186/349] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:22 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1740 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:22.989929 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-eabb2932-f20a-4469-96fb-a09dc8168614 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:22.990566 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-eabb2932-f20a-4469-96fb-a09dc8168614 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:22.996886 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-eabb2932-f20a-4469-96fb-a09dc8168614 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:22.997725 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-eabb2932-f20a-4469-96fb-a09dc8168614 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:22.998568 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-eabb2932-f20a-4469-96fb-a09dc8168614 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:22.999558 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-eabb2932-f20a-4469-96fb-a09dc8168614 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:23.154373 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-eabb2932-f20a-4469-96fb-a09dc8168614 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:23.174632 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-eabb2932-f20a-4469-96fb-a09dc8168614 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.188660 May 10 16:47:23.176055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 164/350] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:22 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:23.327401 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3596c1fa-faa3-40a8-b12f-60964f1207b0 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:23.328704 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3596c1fa-faa3-40a8-b12f-60964f1207b0 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:23.340885 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3596c1fa-faa3-40a8-b12f-60964f1207b0 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:23.341339 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3596c1fa-faa3-40a8-b12f-60964f1207b0 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:23.343445 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3596c1fa-faa3-40a8-b12f-60964f1207b0 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:23.344124 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3596c1fa-faa3-40a8-b12f-60964f1207b0 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:23.348788 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-d181355f-e940-4356-9667-db135f2a31d5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:23.349632 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-d181355f-e940-4356-9667-db135f2a31d5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:23.360001 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d181355f-e940-4356-9667-db135f2a31d5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:23.362793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d181355f-e940-4356-9667-db135f2a31d5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:23.364933 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d181355f-e940-4356-9667-db135f2a31d5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:23.365631 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d181355f-e940-4356-9667-db135f2a31d5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:23.442414 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3596c1fa-faa3-40a8-b12f-60964f1207b0 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:23.449960 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3596c1fa-faa3-40a8-b12f-60964f1207b0 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1278 microversion: 2.1 time: 0.126670 May 10 16:47:23.450995 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 187/351] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:23 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1278 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:23.574438 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-d181355f-e940-4356-9667-db135f2a31d5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:23.583969 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-d181355f-e940-4356-9667-db135f2a31d5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:23.585477 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-d181355f-e940-4356-9667-db135f2a31d5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:23.586632 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-d181355f-e940-4356-9667-db135f2a31d5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1740 microversion: 2.20 time: 0.243086 May 10 16:47:23.587550 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 165/352] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:23 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:47:24.193980 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6c2f9190-78f7-4909-aeab-b1325495b4f0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:24.194669 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6c2f9190-78f7-4909-aeab-b1325495b4f0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:24.213474 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6c2f9190-78f7-4909-aeab-b1325495b4f0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:24.213920 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6c2f9190-78f7-4909-aeab-b1325495b4f0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:24.214881 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6c2f9190-78f7-4909-aeab-b1325495b4f0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:24.217410 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6c2f9190-78f7-4909-aeab-b1325495b4f0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:24.472556 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-5ea9e2d6-24a6-4229-99f7-ed24f0a509ad tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:24.473854 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-5ea9e2d6-24a6-4229-99f7-ed24f0a509ad tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:24.480698 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5ea9e2d6-24a6-4229-99f7-ed24f0a509ad tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:24.487007 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5ea9e2d6-24a6-4229-99f7-ed24f0a509ad tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:24.488017 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5ea9e2d6-24a6-4229-99f7-ed24f0a509ad tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:24.493947 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5ea9e2d6-24a6-4229-99f7-ed24f0a509ad tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:24.521572 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6c2f9190-78f7-4909-aeab-b1325495b4f0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:24.531949 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6c2f9190-78f7-4909-aeab-b1325495b4f0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1503 microversion: 2.1 time: 0.342827 May 10 16:47:24.551533 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 188/353] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:24 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1503 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:24.571926 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-dd477ab6-ad33-438f-99a0-c1e4ebeb6b9f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce5a197e-0820-438b-82fb-f58c5c15c554"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:24.576140 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-dd477ab6-ad33-438f-99a0-c1e4ebeb6b9f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:24.597150 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dd477ab6-ad33-438f-99a0-c1e4ebeb6b9f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:24.598250 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dd477ab6-ad33-438f-99a0-c1e4ebeb6b9f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:24.603885 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dd477ab6-ad33-438f-99a0-c1e4ebeb6b9f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:24.618555 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dd477ab6-ad33-438f-99a0-c1e4ebeb6b9f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:24.688928 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-dd477ab6-ad33-438f-99a0-c1e4ebeb6b9f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] HTTP exception thrown: Cannot 'attach_volume' instance 7072f21c-b362-4442-9b4e-e7ad82c6ab7d while it is in vm_state rescued May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-dd477ab6-ad33-438f-99a0-c1e4ebeb6b9f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Request method failure captured: May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: request: POST /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d/os-volume_attachments HTTP/1.1 May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept: application/json May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Connection: close May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Length: 74 May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Host: 10.222.0.57 May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABiepaUs505RQb-_itGhyItx6PoanxzUvVOQgaz_1Jo9glXWxcoGigpc5wkoPzDRwl-I4vB-wQ4_MxKAUesI6TqrOzBjlBZp69C5J2KLGz6296qMQ3sfqFgSCkXy2WF5NYGkfCnzgy0j3R-znN6Hy6TdvWyTAdluuxXRqfc6leOvHCnPYM May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Id: c0da2d582ad649208e7c4105faee8290 May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1303242210 May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 10 16:47:24.690530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 10 16:47:24.691927 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c0da2d582ad649208e7c4105faee8290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0da2d582ad649208e7c4105faee8290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0da2d582ad649208e7c4105faee8290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c0da2d582ad649208e7c4105faee8290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:47:24.691927 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1303242210 May 10 16:47:24.691927 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Id: c0da2d582ad649208e7c4105faee8290 May 10 16:47:24.691927 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1303242210 May 10 16:47:24.691927 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User: tempest-ServerRescueNegativeTestJSON-1303242210-project May 10 16:47:24.691927 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 10 16:47:24.691927 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 10 16:47:24.691927 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Id: de5e76d5385f44fab03527751a478f1e May 10 16:47:24.691927 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1303242210-project May 10 16:47:24.691927 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: May 10 16:47:24.691927 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: {"volumeAttachment": {"volumeId": "ce5a197e-0820-438b-82fb-f58c5c15c554"}} May 10 16:47:24.691927 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: method: > May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: exception: Cannot 'attach_volume' instance 7072f21c-b362-4442-9b4e-e7ad82c6ab7d while it is in vm_state rescued May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: action_args: {'server_id': '7072f21c-b362-4442-9b4e-e7ad82c6ab7d', 'body': {'volumeAttachment': {'volumeId': 'ce5a197e-0820-438b-82fb-f58c5c15c554'}}} May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7072f21c-b362-4442-9b4e-e7ad82c6ab7d in vm_state rescued. Cannot attach_volume while the instance is in this state. May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:47:24.692732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7072f21c-b362-4442-9b4e-e7ad82c6ab7d while it is in vm_state rescued May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:47:24.694000 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:47:24.695199 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:47:24.695199 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:47:24.695199 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7072f21c-b362-4442-9b4e-e7ad82c6ab7d while it is in vm_state rescued May 10 16:47:24.695199 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:47:24.695469 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-5ea9e2d6-24a6-4229-99f7-ed24f0a509ad tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:24.701936 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-5ea9e2d6-24a6-4229-99f7-ed24f0a509ad tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1276 microversion: 2.1 time: 0.235643 May 10 16:47:24.702743 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 166/354] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:24 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1276 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:24.709038 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-dd477ab6-ad33-438f-99a0-c1e4ebeb6b9f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Returning 409 to user: Cannot 'attach_volume' instance 7072f21c-b362-4442-9b4e-e7ad82c6ab7d while it is in vm_state rescued {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:47:24.710075 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-dd477ab6-ad33-438f-99a0-c1e4ebeb6b9f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "POST /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.156450 May 10 16:47:24.721039 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 189/355] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 16:47:24 2022] POST /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d/os-volume_attachments => generated 152 bytes in 169 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 16:47:24.732489 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-013e7c45-312c-469e-a06c-2fa98b3429ef tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:24.733487 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b236e1ba-b771-4146-b2d9-db673240f405 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:24.733729 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-013e7c45-312c-469e-a06c-2fa98b3429ef tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:24.734046 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b236e1ba-b771-4146-b2d9-db673240f405 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:24.764583 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b236e1ba-b771-4146-b2d9-db673240f405 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:24.765677 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-013e7c45-312c-469e-a06c-2fa98b3429ef tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:24.767181 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b236e1ba-b771-4146-b2d9-db673240f405 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:24.767412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-013e7c45-312c-469e-a06c-2fa98b3429ef tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:24.768036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b236e1ba-b771-4146-b2d9-db673240f405 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:24.768492 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b236e1ba-b771-4146-b2d9-db673240f405 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:24.777329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-013e7c45-312c-469e-a06c-2fa98b3429ef tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:24.780669 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-013e7c45-312c-469e-a06c-2fa98b3429ef tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:25.023754 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b236e1ba-b771-4146-b2d9-db673240f405 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "POST /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d/action" status: 202 len: 0 microversion: 2.1 time: 0.301045 May 10 16:47:25.024386 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 190/356] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 16:47:24 2022] POST /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:47:25.061376 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-aaf46d54-9335-48fa-b5d1-31c193a13a47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:25.064533 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-aaf46d54-9335-48fa-b5d1-31c193a13a47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:25.097206 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aaf46d54-9335-48fa-b5d1-31c193a13a47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:25.100584 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-013e7c45-312c-469e-a06c-2fa98b3429ef tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:25.116323 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aaf46d54-9335-48fa-b5d1-31c193a13a47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:25.116323 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aaf46d54-9335-48fa-b5d1-31c193a13a47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:25.116323 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aaf46d54-9335-48fa-b5d1-31c193a13a47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:25.126629 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-013e7c45-312c-469e-a06c-2fa98b3429ef tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:25.132685 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-013e7c45-312c-469e-a06c-2fa98b3429ef tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:25.134637 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-013e7c45-312c-469e-a06c-2fa98b3429ef tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1740 microversion: 2.20 time: 0.425520 May 10 16:47:25.149129 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 167/357] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:24 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1740 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:25.447445 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-aaf46d54-9335-48fa-b5d1-31c193a13a47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:25.459486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-aaf46d54-9335-48fa-b5d1-31c193a13a47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1511 microversion: 2.1 time: 0.423968 May 10 16:47:25.460442 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 191/358] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:25 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1511 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:25.720785 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-81661076-9d10-4834-9d01-60a0b7a72712 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:25.722129 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-81661076-9d10-4834-9d01-60a0b7a72712 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:25.731250 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-81661076-9d10-4834-9d01-60a0b7a72712 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:25.737746 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-81661076-9d10-4834-9d01-60a0b7a72712 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:25.740453 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-81661076-9d10-4834-9d01-60a0b7a72712 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:25.741037 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-81661076-9d10-4834-9d01-60a0b7a72712 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:26.059247 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-81661076-9d10-4834-9d01-60a0b7a72712 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:26.083220 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-81661076-9d10-4834-9d01-60a0b7a72712 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1318 microversion: 2.1 time: 0.366088 May 10 16:47:26.085362 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 168/359] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:25 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:26.162005 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1b5acf9d-4ff0-4a94-8c11-f436d3e9ed07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:26.163553 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1b5acf9d-4ff0-4a94-8c11-f436d3e9ed07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:26.193673 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b5acf9d-4ff0-4a94-8c11-f436d3e9ed07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:26.195874 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b5acf9d-4ff0-4a94-8c11-f436d3e9ed07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:26.199286 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b5acf9d-4ff0-4a94-8c11-f436d3e9ed07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:26.200431 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b5acf9d-4ff0-4a94-8c11-f436d3e9ed07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:26.478166 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-a471cdd8-153a-4861-9fe3-fb80293f972a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:26.478950 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-a471cdd8-153a-4861-9fe3-fb80293f972a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:26.492321 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a471cdd8-153a-4861-9fe3-fb80293f972a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:26.492321 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a471cdd8-153a-4861-9fe3-fb80293f972a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:26.492928 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a471cdd8-153a-4861-9fe3-fb80293f972a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:26.496714 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a471cdd8-153a-4861-9fe3-fb80293f972a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:26.576435 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1b5acf9d-4ff0-4a94-8c11-f436d3e9ed07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:26.596487 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1b5acf9d-4ff0-4a94-8c11-f436d3e9ed07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:26.606060 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1b5acf9d-4ff0-4a94-8c11-f436d3e9ed07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:26.611507 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1b5acf9d-4ff0-4a94-8c11-f436d3e9ed07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1740 microversion: 2.20 time: 0.456715 May 10 16:47:26.618891 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 192/360] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:26 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1740 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:26.910434 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-a471cdd8-153a-4861-9fe3-fb80293f972a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:26.932545 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-a471cdd8-153a-4861-9fe3-fb80293f972a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1511 microversion: 2.1 time: 0.458767 May 10 16:47:26.933150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 169/361] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:26 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1511 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:27.106097 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-814e428b-ee1b-450b-9993-44eaa0db5054 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:27.107199 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-814e428b-ee1b-450b-9993-44eaa0db5054 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:27.126724 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-814e428b-ee1b-450b-9993-44eaa0db5054 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:27.134199 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-814e428b-ee1b-450b-9993-44eaa0db5054 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:27.136228 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-814e428b-ee1b-450b-9993-44eaa0db5054 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:27.136841 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-814e428b-ee1b-450b-9993-44eaa0db5054 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:27.401100 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-36aaa85f-dbb5-4bb3-97d0-89ce2cf7aa5f req-67ca6e03-a26e-4d0c-a29b-f0437d3ced14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8", "tag": "0dfc5b6b-8673-496e-baeb-ebd76ccf5549"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:27.411156 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-36aaa85f-dbb5-4bb3-97d0-89ce2cf7aa5f req-67ca6e03-a26e-4d0c-a29b-f0437d3ced14 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:27.411777 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-36aaa85f-dbb5-4bb3-97d0-89ce2cf7aa5f req-67ca6e03-a26e-4d0c-a29b-f0437d3ced14 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:27.430873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-36aaa85f-dbb5-4bb3-97d0-89ce2cf7aa5f req-67ca6e03-a26e-4d0c-a29b-f0437d3ced14 service nova] Creating event network-changed:0dfc5b6b-8673-496e-baeb-ebd76ccf5549 for instance 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 on hv-cinder-84130 May 10 16:47:27.438096 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-36aaa85f-dbb5-4bb3-97d0-89ce2cf7aa5f req-67ca6e03-a26e-4d0c-a29b-f0437d3ced14 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041855 May 10 16:47:27.438877 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 170/362] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:47:27.450784 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-814e428b-ee1b-450b-9993-44eaa0db5054 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:27.468029 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-814e428b-ee1b-450b-9993-44eaa0db5054 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1318 microversion: 2.1 time: 0.361902 May 10 16:47:27.488452 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 193/363] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:27 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:27.639120 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-06cbe327-a3fe-4465-8b1e-3e0c99f1ca3b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:27.641685 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-06cbe327-a3fe-4465-8b1e-3e0c99f1ca3b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:27.655779 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-06cbe327-a3fe-4465-8b1e-3e0c99f1ca3b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:27.658180 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-06cbe327-a3fe-4465-8b1e-3e0c99f1ca3b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:27.660144 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-06cbe327-a3fe-4465-8b1e-3e0c99f1ca3b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:27.661751 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-06cbe327-a3fe-4465-8b1e-3e0c99f1ca3b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:27.870337 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-06cbe327-a3fe-4465-8b1e-3e0c99f1ca3b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:27.918599 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-06cbe327-a3fe-4465-8b1e-3e0c99f1ca3b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:27.918599 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-06cbe327-a3fe-4465-8b1e-3e0c99f1ca3b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:27.918599 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-06cbe327-a3fe-4465-8b1e-3e0c99f1ca3b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1740 microversion: 2.20 time: 0.283363 May 10 16:47:27.923222 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 171/364] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:27 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1740 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:47:27.949869 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4aa685f7-ac66-4cf7-8b75-83dbbed09937 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:27.950757 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4aa685f7-ac66-4cf7-8b75-83dbbed09937 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:27.962638 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4aa685f7-ac66-4cf7-8b75-83dbbed09937 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:27.964023 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4aa685f7-ac66-4cf7-8b75-83dbbed09937 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:27.964916 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4aa685f7-ac66-4cf7-8b75-83dbbed09937 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:27.965366 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4aa685f7-ac66-4cf7-8b75-83dbbed09937 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:28.220351 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4aa685f7-ac66-4cf7-8b75-83dbbed09937 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:28.240562 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4aa685f7-ac66-4cf7-8b75-83dbbed09937 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1511 microversion: 2.1 time: 0.292583 May 10 16:47:28.255924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 194/365] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:27 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:28.540995 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-d2499a2a-90ee-40c5-aa85-33a7dedf2c2c tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:28.541943 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-d2499a2a-90ee-40c5-aa85-33a7dedf2c2c tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:28.556859 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d2499a2a-90ee-40c5-aa85-33a7dedf2c2c tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:28.581440 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d2499a2a-90ee-40c5-aa85-33a7dedf2c2c tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:28.589526 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d2499a2a-90ee-40c5-aa85-33a7dedf2c2c tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:28.593175 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d2499a2a-90ee-40c5-aa85-33a7dedf2c2c tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:28.947909 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-14c6c88d-17ea-4b90-a7cf-ac5095721862 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:28.948672 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-14c6c88d-17ea-4b90-a7cf-ac5095721862 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:28.961625 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-14c6c88d-17ea-4b90-a7cf-ac5095721862 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:28.967714 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-14c6c88d-17ea-4b90-a7cf-ac5095721862 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:28.969924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-14c6c88d-17ea-4b90-a7cf-ac5095721862 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:28.970722 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-14c6c88d-17ea-4b90-a7cf-ac5095721862 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:29.029380 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-d2499a2a-90ee-40c5-aa85-33a7dedf2c2c tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:29.038422 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-d2499a2a-90ee-40c5-aa85-33a7dedf2c2c tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1318 microversion: 2.1 time: 0.543512 May 10 16:47:29.055840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 172/366] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:28 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1318 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:29.265188 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b59116e0-ab07-42b4-96d7-2343d4560db0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:29.265762 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-14c6c88d-17ea-4b90-a7cf-ac5095721862 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:29.266349 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-b59116e0-ab07-42b4-96d7-2343d4560db0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:29.279165 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b59116e0-ab07-42b4-96d7-2343d4560db0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:29.279480 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-14c6c88d-17ea-4b90-a7cf-ac5095721862 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:29.281326 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b59116e0-ab07-42b4-96d7-2343d4560db0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:29.283183 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b59116e0-ab07-42b4-96d7-2343d4560db0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:29.283965 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b59116e0-ab07-42b4-96d7-2343d4560db0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:29.309059 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-14c6c88d-17ea-4b90-a7cf-ac5095721862 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:29.309059 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-14c6c88d-17ea-4b90-a7cf-ac5095721862 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1740 microversion: 2.20 time: 0.357497 May 10 16:47:29.312040 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 195/367] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:28 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1740 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:29.557001 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b59116e0-ab07-42b4-96d7-2343d4560db0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:29.565300 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b59116e0-ab07-42b4-96d7-2343d4560db0 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1511 microversion: 2.1 time: 0.306833 May 10 16:47:29.566276 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 173/368] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:29 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1511 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:30.062639 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-940cbc26-13b2-438f-90de-1e34d6fd9c7b tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:30.064057 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-940cbc26-13b2-438f-90de-1e34d6fd9c7b tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:30.083882 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-940cbc26-13b2-438f-90de-1e34d6fd9c7b tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:30.084338 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-940cbc26-13b2-438f-90de-1e34d6fd9c7b tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:30.085137 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-940cbc26-13b2-438f-90de-1e34d6fd9c7b tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:30.085576 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-940cbc26-13b2-438f-90de-1e34d6fd9c7b tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:30.320001 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-31f2523d-a18c-49fd-8e34-ae7eb378eacb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:30.320682 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-31f2523d-a18c-49fd-8e34-ae7eb378eacb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:30.330343 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-31f2523d-a18c-49fd-8e34-ae7eb378eacb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:30.331084 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-31f2523d-a18c-49fd-8e34-ae7eb378eacb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:30.335093 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-31f2523d-a18c-49fd-8e34-ae7eb378eacb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:30.335917 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-31f2523d-a18c-49fd-8e34-ae7eb378eacb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:30.353186 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-940cbc26-13b2-438f-90de-1e34d6fd9c7b tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:30.365567 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-940cbc26-13b2-438f-90de-1e34d6fd9c7b tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1318 microversion: 2.1 time: 0.305290 May 10 16:47:30.366475 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 196/369] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:30 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:30.506867 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-31f2523d-a18c-49fd-8e34-ae7eb378eacb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:30.516189 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-31f2523d-a18c-49fd-8e34-ae7eb378eacb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:30.517797 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-31f2523d-a18c-49fd-8e34-ae7eb378eacb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:30.519804 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-31f2523d-a18c-49fd-8e34-ae7eb378eacb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1740 microversion: 2.20 time: 0.204359 May 10 16:47:30.520842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 174/370] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:30 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:30.586709 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-739df190-5e0f-4205-909f-cf27240323a1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:30.587350 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-739df190-5e0f-4205-909f-cf27240323a1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:30.595255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-739df190-5e0f-4205-909f-cf27240323a1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:30.596088 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-739df190-5e0f-4205-909f-cf27240323a1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:30.597709 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-739df190-5e0f-4205-909f-cf27240323a1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:30.598824 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-739df190-5e0f-4205-909f-cf27240323a1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:30.780375 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-739df190-5e0f-4205-909f-cf27240323a1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:30.791451 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-739df190-5e0f-4205-909f-cf27240323a1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1517 microversion: 2.1 time: 0.213256 May 10 16:47:30.792140 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 197/371] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:30 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1517 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:31.222749 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-d3f49a99-1032-404c-9cea-cca7239908da tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-577617847", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-717045666", "security_groups": [{"name": "tempest-secgroup-smoke-1526997258"}], "block_device_mapping_v2": [{"uuid": "38e91cbf-eb15-4dfd-b552-e9336ef5d482", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f918dd3e-1cb0-4ec1-9ac3-73d6674790cf"}]}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:31.379229 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.network.neutron [None req-d3f49a99-1032-404c-9cea-cca7239908da tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] validate_networks() for [('f918dd3e-1cb0-4ec1-9ac3-73d6674790cf', None, None, None, None, None)] {{(pid=128925) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:47:31.383926 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-38580a81-93f7-418a-9d5d-b540a497fdfd tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:31.385924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-38580a81-93f7-418a-9d5d-b540a497fdfd tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:31.398554 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-38580a81-93f7-418a-9d5d-b540a497fdfd tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:31.403947 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-38580a81-93f7-418a-9d5d-b540a497fdfd tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:31.404930 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-38580a81-93f7-418a-9d5d-b540a497fdfd tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:31.405383 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-38580a81-93f7-418a-9d5d-b540a497fdfd tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:31.646304 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-38580a81-93f7-418a-9d5d-b540a497fdfd tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:31.654290 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-38580a81-93f7-418a-9d5d-b540a497fdfd tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1318 microversion: 2.1 time: 0.275744 May 10 16:47:31.672756 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 198/372] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:31 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:31.678466 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-11a4025d-ffe5-4c01-baaf-8dc634959b1e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:31.679125 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-11a4025d-ffe5-4c01-baaf-8dc634959b1e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:31.686936 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-11a4025d-ffe5-4c01-baaf-8dc634959b1e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:31.687415 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-11a4025d-ffe5-4c01-baaf-8dc634959b1e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:31.688192 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-11a4025d-ffe5-4c01-baaf-8dc634959b1e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:31.688632 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-11a4025d-ffe5-4c01-baaf-8dc634959b1e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:31.901244 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-11a4025d-ffe5-4c01-baaf-8dc634959b1e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:31.909530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-11a4025d-ffe5-4c01-baaf-8dc634959b1e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:31.911435 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-11a4025d-ffe5-4c01-baaf-8dc634959b1e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:31.912929 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-11a4025d-ffe5-4c01-baaf-8dc634959b1e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1740 microversion: 2.20 time: 0.238892 May 10 16:47:31.913747 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 199/373] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:31 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:31.958311 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-d3f49a99-1032-404c-9cea-cca7239908da tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Flavor limits 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:47:31.959199 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-d3f49a99-1032-404c-9cea-cca7239908da tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Image limits 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:47:31.960573 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-d3f49a99-1032-404c-9cea-cca7239908da tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Flavor pref 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:47:31.961407 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-d3f49a99-1032-404c-9cea-cca7239908da tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Image pref 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:47:31.962480 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-d3f49a99-1032-404c-9cea-cca7239908da tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:47:31.972481 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d3f49a99-1032-404c-9cea-cca7239908da tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:31.973179 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d3f49a99-1032-404c-9cea-cca7239908da tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:31.974146 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d3f49a99-1032-404c-9cea-cca7239908da tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:31.974585 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d3f49a99-1032-404c-9cea-cca7239908da tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:31.995463 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-d3f49a99-1032-404c-9cea-cca7239908da tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Getting quotas for project 84465c37c1474aa68266191586ba2953. Resources: {'instances', 'cores', 'ram'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:47:32.002612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-d3f49a99-1032-404c-9cea-cca7239908da tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Getting quotas for user 1bc2420288964c389f6529d9ede09bd4 and project 84465c37c1474aa68266191586ba2953. Resources: {'instances', 'cores', 'ram'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:47:32.671092 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-892e7002-a7a1-457f-bffe-62d0189787d4 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:32.671740 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-892e7002-a7a1-457f-bffe-62d0189787d4 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:32.680052 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-892e7002-a7a1-457f-bffe-62d0189787d4 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:32.680522 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-892e7002-a7a1-457f-bffe-62d0189787d4 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:32.681957 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-892e7002-a7a1-457f-bffe-62d0189787d4 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:32.682539 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-892e7002-a7a1-457f-bffe-62d0189787d4 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:32.845537 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-892e7002-a7a1-457f-bffe-62d0189787d4 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:32.867148 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-892e7002-a7a1-457f-bffe-62d0189787d4 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1318 microversion: 2.1 time: 0.198358 May 10 16:47:32.867723 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 200/374] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:32 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:32.933392 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b10213b3-6d32-4ec6-bbbe-59bbaf0af33f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:32.934270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b10213b3-6d32-4ec6-bbbe-59bbaf0af33f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:32.941491 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b10213b3-6d32-4ec6-bbbe-59bbaf0af33f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:32.942351 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b10213b3-6d32-4ec6-bbbe-59bbaf0af33f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:32.943342 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b10213b3-6d32-4ec6-bbbe-59bbaf0af33f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:32.944244 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b10213b3-6d32-4ec6-bbbe-59bbaf0af33f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:33.064704 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-d3f49a99-1032-404c-9cea-cca7239908da tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Going to run 1 instances... {{(pid=128925) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:47:33.066822 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-d3f49a99-1032-404c-9cea-cca7239908da tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='38e91cbf-eb15-4dfd-b552-e9336ef5d482',volume_size=None,volume_type=None)] {{(pid=128925) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:47:33.189295 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b10213b3-6d32-4ec6-bbbe-59bbaf0af33f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:33.200305 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b10213b3-6d32-4ec6-bbbe-59bbaf0af33f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:33.203549 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b10213b3-6d32-4ec6-bbbe-59bbaf0af33f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:33.205366 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b10213b3-6d32-4ec6-bbbe-59bbaf0af33f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1740 microversion: 2.20 time: 0.276576 May 10 16:47:33.209180 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 201/375] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:32 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1740 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:47:33.219364 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4172c32f-10df-404c-ae30-e606cd926307 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-411515271", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1171161426", "security_groups": [{"name": "tempest-secgroup-smoke-1492822261"}], "networks": [{"uuid": "c6ba2f7c-b928-43b8-8b8b-de3594d00d8d"}], "block_device_mapping_v2": [{"uuid": "f02e19b1-c05a-4802-a427-76def37803ff", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:33.347685 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-d3f49a99-1032-404c-9cea-cca7239908da tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.129154 May 10 16:47:33.350916 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 175/376] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 16:47:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 2134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:47:33.366830 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b6e46122-84f7-4ecd-9556-bceecab2a982 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:33.368359 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-b6e46122-84f7-4ecd-9556-bceecab2a982 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:33.397742 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-4172c32f-10df-404c-ae30-e606cd926307 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] validate_networks() for [('c6ba2f7c-b928-43b8-8b8b-de3594d00d8d', None, None, None, None, None)] {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:47:33.480013 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b6e46122-84f7-4ecd-9556-bceecab2a982 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:33.487380 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b6e46122-84f7-4ecd-9556-bceecab2a982 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1093 microversion: 2.1 time: 0.128876 May 10 16:47:33.490337 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 176/377] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:33 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1093 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:33.872617 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-4172c32f-10df-404c-ae30-e606cd926307 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:47:33.879503 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-4172c32f-10df-404c-ae30-e606cd926307 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:47:33.882047 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-4172c32f-10df-404c-ae30-e606cd926307 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:47:33.882698 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-4172c32f-10df-404c-ae30-e606cd926307 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:47:33.883506 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-4172c32f-10df-404c-ae30-e606cd926307 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:47:33.890559 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-3aef60ae-2f1d-4b17-bb3f-cc70a7ecc7e6 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:33.897314 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-3aef60ae-2f1d-4b17-bb3f-cc70a7ecc7e6 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:33.907344 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4172c32f-10df-404c-ae30-e606cd926307 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:33.908069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4172c32f-10df-404c-ae30-e606cd926307 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:33.909111 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4172c32f-10df-404c-ae30-e606cd926307 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:33.909738 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4172c32f-10df-404c-ae30-e606cd926307 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:33.923976 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3aef60ae-2f1d-4b17-bb3f-cc70a7ecc7e6 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:33.924562 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3aef60ae-2f1d-4b17-bb3f-cc70a7ecc7e6 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:33.925473 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3aef60ae-2f1d-4b17-bb3f-cc70a7ecc7e6 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:33.926372 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3aef60ae-2f1d-4b17-bb3f-cc70a7ecc7e6 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:33.955689 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-4172c32f-10df-404c-ae30-e606cd926307 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Getting quotas for project a5da35de420b4b908dde94da66c0ecd2. Resources: {'instances', 'cores', 'ram'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:47:33.993339 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-4172c32f-10df-404c-ae30-e606cd926307 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Getting quotas for user 97dcd026697f4ac099a2f518408b89ed and project a5da35de420b4b908dde94da66c0ecd2. Resources: {'instances', 'cores', 'ram'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:47:34.133177 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4172c32f-10df-404c-ae30-e606cd926307 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:47:34.134301 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-3aef60ae-2f1d-4b17-bb3f-cc70a7ecc7e6 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:34.135537 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4172c32f-10df-404c-ae30-e606cd926307 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f02e19b1-c05a-4802-a427-76def37803ff',volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:47:34.154580 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-3aef60ae-2f1d-4b17-bb3f-cc70a7ecc7e6 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1318 microversion: 2.1 time: 0.268852 May 10 16:47:34.166232 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 177/378] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:33 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:34.238625 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-7f9b9434-129e-474e-9b2c-ace2679eb129 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:34.238625 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-7f9b9434-129e-474e-9b2c-ace2679eb129 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:34.264768 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7f9b9434-129e-474e-9b2c-ace2679eb129 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:34.265771 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7f9b9434-129e-474e-9b2c-ace2679eb129 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:34.266564 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7f9b9434-129e-474e-9b2c-ace2679eb129 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:34.267034 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7f9b9434-129e-474e-9b2c-ace2679eb129 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:34.479664 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7f9b9434-129e-474e-9b2c-ace2679eb129 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:34.491891 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7f9b9434-129e-474e-9b2c-ace2679eb129 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:34.494142 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7f9b9434-129e-474e-9b2c-ace2679eb129 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:34.496184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-7f9b9434-129e-474e-9b2c-ace2679eb129 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1740 microversion: 2.20 time: 0.272044 May 10 16:47:34.496963 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 178/379] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:34 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1740 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:47:34.515885 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-5b6e4398-4827-495b-90f7-d6ae08da1ad4 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:34.516903 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-5b6e4398-4827-495b-90f7-d6ae08da1ad4 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:34.518158 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4172c32f-10df-404c-ae30-e606cd926307 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.307333 May 10 16:47:34.519542 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 202/380] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 16:47:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1310 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:47:34.530733 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5b6e4398-4827-495b-90f7-d6ae08da1ad4 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:34.531533 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5b6e4398-4827-495b-90f7-d6ae08da1ad4 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:34.532601 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5b6e4398-4827-495b-90f7-d6ae08da1ad4 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:34.533081 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7b0e2ec8-c13d-492f-86ee-a274bdfd5a39 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:34.533461 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5b6e4398-4827-495b-90f7-d6ae08da1ad4 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:34.534450 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7b0e2ec8-c13d-492f-86ee-a274bdfd5a39 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:34.630310 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7b0e2ec8-c13d-492f-86ee-a274bdfd5a39 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:34.653169 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7b0e2ec8-c13d-492f-86ee-a274bdfd5a39 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1088 microversion: 2.1 time: 0.125105 May 10 16:47:34.657103 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 203/381] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:34 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1088 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:34.721480 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-5b6e4398-4827-495b-90f7-d6ae08da1ad4 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:34.729433 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-5b6e4398-4827-495b-90f7-d6ae08da1ad4 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1191 microversion: 2.1 time: 0.223072 May 10 16:47:34.733511 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 179/382] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:34 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1191 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:35.173939 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-363befbb-a25e-46dd-9081-a0be4884712f tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:35.179363 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-363befbb-a25e-46dd-9081-a0be4884712f tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:35.217467 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-363befbb-a25e-46dd-9081-a0be4884712f tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:35.218103 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-363befbb-a25e-46dd-9081-a0be4884712f tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:35.219201 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-363befbb-a25e-46dd-9081-a0be4884712f tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:35.219907 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-363befbb-a25e-46dd-9081-a0be4884712f tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:35.446784 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f9ed5b77-fdcd-4f01-bdd8-b39cafa52929 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Action: 'create', calling method: .version_select at 0x7fdf196ac820>, body: {"keypair": {"name": "tempest-keypair-96809514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2DpgBY5oTpsA1WAesR9yDyrDrJZZ0DdgVJsGzy/J7ebFZzbdF1AIoQK2vOVfxm6HH/FUTpj33cRpN41jxBmrjzZrV14nl9i1HWlJdTLAPn6A1vjzeSOV0AxCSdydK7/Q=="}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:35.519486 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-f9ed5b77-fdcd-4f01-bdd8-b39cafa52929 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Getting quotas for project c0da2d582ad649208e7c4105faee8290. Resources: {'key_pairs'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:47:35.535335 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-f9ed5b77-fdcd-4f01-bdd8-b39cafa52929 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Getting quotas for user de5e76d5385f44fab03527751a478f1e and project c0da2d582ad649208e7c4105faee8290. Resources: {'key_pairs'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:47:35.591551 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-f9ed5b77-fdcd-4f01-bdd8-b39cafa52929 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.155940 May 10 16:47:35.596700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 180/383] 10.222.0.57 () {60 vars in 1158 bytes} [Tue May 10 16:47:35 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:47:35.610647 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-ee3cad69-9d77-4f80-8aa2-ef902ef0bb10 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:35.612123 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-ee3cad69-9d77-4f80-8aa2-ef902ef0bb10 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:35.624852 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-363befbb-a25e-46dd-9081-a0be4884712f tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:35.640173 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-363befbb-a25e-46dd-9081-a0be4884712f tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1318 microversion: 2.1 time: 0.469757 May 10 16:47:35.642544 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 204/384] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:35 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:35.643392 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ee3cad69-9d77-4f80-8aa2-ef902ef0bb10 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:35.644152 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ee3cad69-9d77-4f80-8aa2-ef902ef0bb10 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:35.645241 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ee3cad69-9d77-4f80-8aa2-ef902ef0bb10 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:35.646328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ee3cad69-9d77-4f80-8aa2-ef902ef0bb10 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:35.677979 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6727e2d9-b526-4b47-8e10-25c81a2b17c9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:35.678925 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6727e2d9-b526-4b47-8e10-25c81a2b17c9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:35.691551 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6727e2d9-b526-4b47-8e10-25c81a2b17c9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:35.694148 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6727e2d9-b526-4b47-8e10-25c81a2b17c9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:35.698922 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6727e2d9-b526-4b47-8e10-25c81a2b17c9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:35.699419 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6727e2d9-b526-4b47-8e10-25c81a2b17c9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:35.901573 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6727e2d9-b526-4b47-8e10-25c81a2b17c9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:35.910504 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6727e2d9-b526-4b47-8e10-25c81a2b17c9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1130 microversion: 2.1 time: 0.241272 May 10 16:47:35.921005 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 205/385] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:35 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1130 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:35.926794 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e38aaa66-5663-48f9-aafd-c3113ce19669 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:35.929018 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e38aaa66-5663-48f9-aafd-c3113ce19669 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:35.942111 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e38aaa66-5663-48f9-aafd-c3113ce19669 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:35.943501 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e38aaa66-5663-48f9-aafd-c3113ce19669 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:35.946164 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e38aaa66-5663-48f9-aafd-c3113ce19669 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:35.947202 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e38aaa66-5663-48f9-aafd-c3113ce19669 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:36.084099 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e38aaa66-5663-48f9-aafd-c3113ce19669 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:36.096001 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ee3cad69-9d77-4f80-8aa2-ef902ef0bb10 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:36.099209 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e38aaa66-5663-48f9-aafd-c3113ce19669 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1209 microversion: 2.1 time: 0.176663 May 10 16:47:36.109133 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 206/386] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:35 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1209 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:36.126810 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ee3cad69-9d77-4f80-8aa2-ef902ef0bb10 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:36.129297 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ee3cad69-9d77-4f80-8aa2-ef902ef0bb10 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:36.131395 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-ee3cad69-9d77-4f80-8aa2-ef902ef0bb10 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1740 microversion: 2.20 time: 0.532535 May 10 16:47:36.132660 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 181/387] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:35 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1740 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:36.659382 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e31e80a4-f5e4-4aca-a164-e5beb16c6de5 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:36.660633 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e31e80a4-f5e4-4aca-a164-e5beb16c6de5 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:36.672001 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e31e80a4-f5e4-4aca-a164-e5beb16c6de5 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:36.674205 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e31e80a4-f5e4-4aca-a164-e5beb16c6de5 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:36.675328 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e31e80a4-f5e4-4aca-a164-e5beb16c6de5 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:36.677355 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e31e80a4-f5e4-4aca-a164-e5beb16c6de5 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:36.923666 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e31e80a4-f5e4-4aca-a164-e5beb16c6de5 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:36.932842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-0272802f-42d5-4a82-9c9b-0dbcf1bc42a9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:36.934498 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-0272802f-42d5-4a82-9c9b-0dbcf1bc42a9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:36.940322 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e31e80a4-f5e4-4aca-a164-e5beb16c6de5 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1318 microversion: 2.1 time: 0.286261 May 10 16:47:36.948245 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 207/388] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:36 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:36.949637 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0272802f-42d5-4a82-9c9b-0dbcf1bc42a9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:36.950203 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0272802f-42d5-4a82-9c9b-0dbcf1bc42a9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:36.952378 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0272802f-42d5-4a82-9c9b-0dbcf1bc42a9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:36.952982 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0272802f-42d5-4a82-9c9b-0dbcf1bc42a9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:37.055861 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-0272802f-42d5-4a82-9c9b-0dbcf1bc42a9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:37.064505 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-0272802f-42d5-4a82-9c9b-0dbcf1bc42a9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1194 microversion: 2.1 time: 0.139310 May 10 16:47:37.080266 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 182/389] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:36 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1194 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:37.117159 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-fa31d22d-0c39-494b-a957-1cbdfb0426f4 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:37.124080 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-fa31d22d-0c39-494b-a957-1cbdfb0426f4 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:37.134903 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa31d22d-0c39-494b-a957-1cbdfb0426f4 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:37.140472 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa31d22d-0c39-494b-a957-1cbdfb0426f4 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:37.142039 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa31d22d-0c39-494b-a957-1cbdfb0426f4 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:37.142657 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-fa31d22d-0c39-494b-a957-1cbdfb0426f4 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:37.151726 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-24625246-b53e-413a-8461-aad9c042fcb4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:37.152399 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-24625246-b53e-413a-8461-aad9c042fcb4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:37.165993 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-24625246-b53e-413a-8461-aad9c042fcb4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:37.166498 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-24625246-b53e-413a-8461-aad9c042fcb4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:37.167347 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-24625246-b53e-413a-8461-aad9c042fcb4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:37.167795 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-24625246-b53e-413a-8461-aad9c042fcb4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:37.400116 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-fa31d22d-0c39-494b-a957-1cbdfb0426f4 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:37.422712 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-fa31d22d-0c39-494b-a957-1cbdfb0426f4 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.307233 May 10 16:47:37.423423 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 208/390] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:37 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:37.459794 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-24625246-b53e-413a-8461-aad9c042fcb4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:37.470471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-24625246-b53e-413a-8461-aad9c042fcb4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:37.479481 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-24625246-b53e-413a-8461-aad9c042fcb4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:37.481616 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-24625246-b53e-413a-8461-aad9c042fcb4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1722 microversion: 2.20 time: 0.335368 May 10 16:47:37.486920 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 183/391] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:37 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1722 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:47:37.965707 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d16fff9e-e0dd-4c3a-80c7-c6d0b8e95a2b tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:37.968854 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d16fff9e-e0dd-4c3a-80c7-c6d0b8e95a2b tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:38.025844 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d16fff9e-e0dd-4c3a-80c7-c6d0b8e95a2b tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:38.034223 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d16fff9e-e0dd-4c3a-80c7-c6d0b8e95a2b tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:38.038739 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d16fff9e-e0dd-4c3a-80c7-c6d0b8e95a2b tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:38.041552 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d16fff9e-e0dd-4c3a-80c7-c6d0b8e95a2b tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:38.087174 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-138d80ba-6bae-4096-99e7-83b94ea87a2c tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:38.087787 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-138d80ba-6bae-4096-99e7-83b94ea87a2c tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:38.096562 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-138d80ba-6bae-4096-99e7-83b94ea87a2c tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:38.097014 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-138d80ba-6bae-4096-99e7-83b94ea87a2c tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:38.097789 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-138d80ba-6bae-4096-99e7-83b94ea87a2c tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:38.098223 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-138d80ba-6bae-4096-99e7-83b94ea87a2c tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:38.555945 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-138d80ba-6bae-4096-99e7-83b94ea87a2c tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:38.603072 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-138d80ba-6bae-4096-99e7-83b94ea87a2c tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1204 microversion: 2.1 time: 0.519560 May 10 16:47:38.627081 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 184/392] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:38 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1204 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:38.634370 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b4929b6e-257b-44a6-a120-c262723eb35e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:38.635433 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-b4929b6e-257b-44a6-a120-c262723eb35e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:38.643377 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b4929b6e-257b-44a6-a120-c262723eb35e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:38.644134 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b4929b6e-257b-44a6-a120-c262723eb35e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:38.645089 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b4929b6e-257b-44a6-a120-c262723eb35e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:38.645814 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b4929b6e-257b-44a6-a120-c262723eb35e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:38.976084 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d16fff9e-e0dd-4c3a-80c7-c6d0b8e95a2b tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:38.999146 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d16fff9e-e0dd-4c3a-80c7-c6d0b8e95a2b tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1318 microversion: 2.1 time: 1.037815 May 10 16:47:39.010946 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 209/393] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:37 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1318 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:39.026889 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-dbebc26e-696d-4880-9c11-75aed09e3bb6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:39.032726 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-dbebc26e-696d-4880-9c11-75aed09e3bb6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:39.054247 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dbebc26e-696d-4880-9c11-75aed09e3bb6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:39.054923 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dbebc26e-696d-4880-9c11-75aed09e3bb6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:39.057375 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dbebc26e-696d-4880-9c11-75aed09e3bb6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:39.058091 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dbebc26e-696d-4880-9c11-75aed09e3bb6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:39.493300 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b4929b6e-257b-44a6-a120-c262723eb35e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:39.522226 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b4929b6e-257b-44a6-a120-c262723eb35e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.891941 May 10 16:47:39.523255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 185/394] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:38 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:39.536344 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-a9135856-3c16-430b-a516-4bcf0f5e3f5d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1908820282", "imageRef": "3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b76e54b1-7d46-4b84-b7a6-7fd5103bce00"}], "security_groups": [{"name": "tempest-securitygroup--643241884"}], "key_name": "tempest-keypair-96809514", "user_data": "}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:39.599193 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-dbebc26e-696d-4880-9c11-75aed09e3bb6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:39.607159 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-dbebc26e-696d-4880-9c11-75aed09e3bb6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:39.612348 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-dbebc26e-696d-4880-9c11-75aed09e3bb6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:39.617819 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-dbebc26e-696d-4880-9c11-75aed09e3bb6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1722 microversion: 2.20 time: 0.604285 May 10 16:47:39.628970 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 210/395] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:39 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1722 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:39.635121 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d6cbf247-9113-48c7-aa00-bb0a85b55137 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:39.639717 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d6cbf247-9113-48c7-aa00-bb0a85b55137 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:39.691073 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d6cbf247-9113-48c7-aa00-bb0a85b55137 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:39.691547 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d6cbf247-9113-48c7-aa00-bb0a85b55137 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:39.692346 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d6cbf247-9113-48c7-aa00-bb0a85b55137 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:39.694064 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d6cbf247-9113-48c7-aa00-bb0a85b55137 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:39.893585 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d6cbf247-9113-48c7-aa00-bb0a85b55137 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:39.907059 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d6cbf247-9113-48c7-aa00-bb0a85b55137 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1192 microversion: 2.1 time: 0.272890 May 10 16:47:39.907933 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 211/396] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:39 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1192 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:39.952463 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.network.neutron [None req-a9135856-3c16-430b-a516-4bcf0f5e3f5d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] validate_networks() for [('b76e54b1-7d46-4b84-b7a6-7fd5103bce00', None, None, None, None, None)] {{(pid=128925) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:47:40.032917 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0f54c6cf-769a-4fd5-82b9-9ecccf93e0c7 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:40.034146 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0f54c6cf-769a-4fd5-82b9-9ecccf93e0c7 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:40.065921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f54c6cf-769a-4fd5-82b9-9ecccf93e0c7 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:40.066379 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f54c6cf-769a-4fd5-82b9-9ecccf93e0c7 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:40.070099 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f54c6cf-769a-4fd5-82b9-9ecccf93e0c7 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:40.071524 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0f54c6cf-769a-4fd5-82b9-9ecccf93e0c7 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:40.797093 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0f54c6cf-769a-4fd5-82b9-9ecccf93e0c7 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:40.808096 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0f54c6cf-769a-4fd5-82b9-9ecccf93e0c7 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1318 microversion: 2.1 time: 0.784528 May 10 16:47:40.808914 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 212/397] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:40 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1318 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:40.815486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-308dba6a-6c32-4817-b38e-a7a86771be5e req-b459e650-d49d-42c3-8233-ea08fafa2568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a49eb5-dff1-452f-9e73-a8a9b0c64649", "name": "network-vif-unplugged", "status": "completed", "tag": "0e22ce60-edf0-4181-80b7-08f1d62c396b"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:40.845514 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-308dba6a-6c32-4817-b38e-a7a86771be5e req-b459e650-d49d-42c3-8233-ea08fafa2568 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:40.845967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-308dba6a-6c32-4817-b38e-a7a86771be5e req-b459e650-d49d-42c3-8233-ea08fafa2568 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:40.893095 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-308dba6a-6c32-4817-b38e-a7a86771be5e req-b459e650-d49d-42c3-8233-ea08fafa2568 service nova] Creating event network-vif-unplugged:0e22ce60-edf0-4181-80b7-08f1d62c396b for instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 on hv-cinder-84130 May 10 16:47:40.911624 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-308dba6a-6c32-4817-b38e-a7a86771be5e req-b459e650-d49d-42c3-8233-ea08fafa2568 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092634 May 10 16:47:40.912696 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 213/398] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:47:40.927495 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-2393f5c7-fa22-4d99-938e-5fa2af738d22 req-6c535ae7-216a-4010-a147-4a1798607c33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "256c0577-62c0-4b3f-bc59-3171e7928b0c", "tag": "7f137a16-3c79-4550-b56b-4ded57073eee"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:40.940503 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-2393f5c7-fa22-4d99-938e-5fa2af738d22 req-6c535ae7-216a-4010-a147-4a1798607c33 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:40.940956 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-2393f5c7-fa22-4d99-938e-5fa2af738d22 req-6c535ae7-216a-4010-a147-4a1798607c33 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:40.953348 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-2393f5c7-fa22-4d99-938e-5fa2af738d22 req-6c535ae7-216a-4010-a147-4a1798607c33 service nova] Creating event network-changed:7f137a16-3c79-4550-b56b-4ded57073eee for instance 256c0577-62c0-4b3f-bc59-3171e7928b0c on hv-cinder-84130 May 10 16:47:40.958855 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-2393f5c7-fa22-4d99-938e-5fa2af738d22 req-6c535ae7-216a-4010-a147-4a1798607c33 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044096 May 10 16:47:40.959999 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 214/399] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:47:40.972145 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-90025736-e3f2-4b46-b0d1-a245596dbe06 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:40.973033 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-90025736-e3f2-4b46-b0d1-a245596dbe06 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:40.981290 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-90025736-e3f2-4b46-b0d1-a245596dbe06 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:40.981936 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-90025736-e3f2-4b46-b0d1-a245596dbe06 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:40.983296 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-90025736-e3f2-4b46-b0d1-a245596dbe06 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:40.983729 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-90025736-e3f2-4b46-b0d1-a245596dbe06 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:41.060013 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-a9135856-3c16-430b-a516-4bcf0f5e3f5d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Flavor limits 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:47:41.064104 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-a9135856-3c16-430b-a516-4bcf0f5e3f5d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Image limits 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:47:41.064801 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-a9135856-3c16-430b-a516-4bcf0f5e3f5d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Flavor pref 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:47:41.065371 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-a9135856-3c16-430b-a516-4bcf0f5e3f5d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Image pref 0:0:0 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:47:41.066057 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.virt.hardware [None req-a9135856-3c16-430b-a516-4bcf0f5e3f5d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128925) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:47:41.075064 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a9135856-3c16-430b-a516-4bcf0f5e3f5d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:41.075780 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a9135856-3c16-430b-a516-4bcf0f5e3f5d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:41.076802 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a9135856-3c16-430b-a516-4bcf0f5e3f5d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:41.077424 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a9135856-3c16-430b-a516-4bcf0f5e3f5d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:41.103776 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-a9135856-3c16-430b-a516-4bcf0f5e3f5d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Getting quotas for project c0da2d582ad649208e7c4105faee8290. Resources: {'instances', 'cores', 'ram'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:47:41.108711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-a9135856-3c16-430b-a516-4bcf0f5e3f5d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Getting quotas for user de5e76d5385f44fab03527751a478f1e and project c0da2d582ad649208e7c4105faee8290. Resources: {'instances', 'cores', 'ram'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:47:41.125250 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-a9135856-3c16-430b-a516-4bcf0f5e3f5d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Going to run 1 instances... {{(pid=128925) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:47:41.130044 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-a9135856-3c16-430b-a516-4bcf0f5e3f5d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128925) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:47:41.216493 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-a9135856-3c16-430b-a516-4bcf0f5e3f5d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.691779 May 10 16:47:41.217935 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 186/400] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 16:47:39 2022] POST /compute/v2.1/servers => generated 408 bytes in 1694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:47:41.222716 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-d314874f-48b3-4241-9527-d20d3561e8b3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:41.223544 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-d314874f-48b3-4241-9527-d20d3561e8b3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:41.223738 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-90025736-e3f2-4b46-b0d1-a245596dbe06 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:41.231332 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-90025736-e3f2-4b46-b0d1-a245596dbe06 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.269543 May 10 16:47:41.231996 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d314874f-48b3-4241-9527-d20d3561e8b3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:41.240831 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d314874f-48b3-4241-9527-d20d3561e8b3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:41.242183 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d314874f-48b3-4241-9527-d20d3561e8b3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:41.242853 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d314874f-48b3-4241-9527-d20d3561e8b3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:41.243356 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 215/401] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:40 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:41.248812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f8c9c503-7c0b-4c53-8854-7507950b7145 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:41.249387 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f8c9c503-7c0b-4c53-8854-7507950b7145 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:41.269776 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f8c9c503-7c0b-4c53-8854-7507950b7145 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:41.273719 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f8c9c503-7c0b-4c53-8854-7507950b7145 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:41.276545 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f8c9c503-7c0b-4c53-8854-7507950b7145 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:41.278388 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f8c9c503-7c0b-4c53-8854-7507950b7145 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:41.606014 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f8c9c503-7c0b-4c53-8854-7507950b7145 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:41.620929 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f8c9c503-7c0b-4c53-8854-7507950b7145 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.375677 May 10 16:47:41.621873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 216/402] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:41 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:41.626440 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-11792279-a15d-4593-94cf-b66bb2c530df tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:41.632734 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-11792279-a15d-4593-94cf-b66bb2c530df tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:41.744847 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-11792279-a15d-4593-94cf-b66bb2c530df tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:41.759961 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-11792279-a15d-4593-94cf-b66bb2c530df tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1244 microversion: 2.1 time: 0.136937 May 10 16:47:41.762659 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 217/403] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:41 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1244 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:41.825879 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-d314874f-48b3-4241-9527-d20d3561e8b3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:41.827167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b476507c-dcb0-42e7-96e4-d2b6c24bce71 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:41.827871 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b476507c-dcb0-42e7-96e4-d2b6c24bce71 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:41.844826 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b476507c-dcb0-42e7-96e4-d2b6c24bce71 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:41.845289 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b476507c-dcb0-42e7-96e4-d2b6c24bce71 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:41.845811 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-d314874f-48b3-4241-9527-d20d3561e8b3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:41.846086 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b476507c-dcb0-42e7-96e4-d2b6c24bce71 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:41.846528 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b476507c-dcb0-42e7-96e4-d2b6c24bce71 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:41.848953 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-d314874f-48b3-4241-9527-d20d3561e8b3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:41.850160 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-d314874f-48b3-4241-9527-d20d3561e8b3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1722 microversion: 2.20 time: 0.631115 May 10 16:47:41.866155 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 187/404] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:41 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1722 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:42.248977 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-95414f39-3bb9-4a48-8c1f-e5603a85178e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:42.249663 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-95414f39-3bb9-4a48-8c1f-e5603a85178e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:42.259255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-95414f39-3bb9-4a48-8c1f-e5603a85178e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:42.263309 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-95414f39-3bb9-4a48-8c1f-e5603a85178e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:42.266473 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-95414f39-3bb9-4a48-8c1f-e5603a85178e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:42.266881 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b476507c-dcb0-42e7-96e4-d2b6c24bce71 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:42.267991 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-95414f39-3bb9-4a48-8c1f-e5603a85178e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:42.280719 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b476507c-dcb0-42e7-96e4-d2b6c24bce71 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1318 microversion: 2.1 time: 0.458799 May 10 16:47:42.281433 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 218/405] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:41 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:42.547799 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-95414f39-3bb9-4a48-8c1f-e5603a85178e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:42.556556 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-95414f39-3bb9-4a48-8c1f-e5603a85178e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.311582 May 10 16:47:42.575067 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 188/406] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:42 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:42.637647 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7447701d-9f90-414d-8708-668047e3cb75 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:42.638267 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7447701d-9f90-414d-8708-668047e3cb75 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:42.649650 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7447701d-9f90-414d-8708-668047e3cb75 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:42.650122 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7447701d-9f90-414d-8708-668047e3cb75 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:42.650927 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7447701d-9f90-414d-8708-668047e3cb75 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:42.651664 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7447701d-9f90-414d-8708-668047e3cb75 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:42.778024 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-55d847e8-8155-4eda-bac8-c4e326cae4ed tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:42.778641 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-55d847e8-8155-4eda-bac8-c4e326cae4ed tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:42.788334 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-55d847e8-8155-4eda-bac8-c4e326cae4ed tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:42.794408 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-55d847e8-8155-4eda-bac8-c4e326cae4ed tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:42.795564 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-55d847e8-8155-4eda-bac8-c4e326cae4ed tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:42.796162 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-55d847e8-8155-4eda-bac8-c4e326cae4ed tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:42.919708 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-55d847e8-8155-4eda-bac8-c4e326cae4ed tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:42.942772 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-55d847e8-8155-4eda-bac8-c4e326cae4ed tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1296 microversion: 2.1 time: 0.168800 May 10 16:47:42.952369 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 189/407] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:42 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1296 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:42.961494 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-4d03e409-0e54-45bf-8e65-f0a806c68f26 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:42.974486 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-4d03e409-0e54-45bf-8e65-f0a806c68f26 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:42.981268 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4d03e409-0e54-45bf-8e65-f0a806c68f26 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:42.983541 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4d03e409-0e54-45bf-8e65-f0a806c68f26 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:42.986361 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4d03e409-0e54-45bf-8e65-f0a806c68f26 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:42.987566 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4d03e409-0e54-45bf-8e65-f0a806c68f26 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:43.116270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7447701d-9f90-414d-8708-668047e3cb75 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:43.128133 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7447701d-9f90-414d-8708-668047e3cb75 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.494071 May 10 16:47:43.129724 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 219/408] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:42 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:43.143225 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-077103bd-a009-456b-bd79-f6ccf065f44e req-d5ff2f9e-2d59-4d42-ae88-041e4e15ea5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8", "name": "network-vif-plugged", "status": "completed", "tag": "0dfc5b6b-8673-496e-baeb-ebd76ccf5549"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:43.152951 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-077103bd-a009-456b-bd79-f6ccf065f44e req-d5ff2f9e-2d59-4d42-ae88-041e4e15ea5f service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:43.154544 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-077103bd-a009-456b-bd79-f6ccf065f44e req-d5ff2f9e-2d59-4d42-ae88-041e4e15ea5f service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:43.171320 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-077103bd-a009-456b-bd79-f6ccf065f44e req-d5ff2f9e-2d59-4d42-ae88-041e4e15ea5f service nova] Creating event network-vif-plugged:0dfc5b6b-8673-496e-baeb-ebd76ccf5549 for instance 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 on hv-cinder-84130 May 10 16:47:43.182344 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-077103bd-a009-456b-bd79-f6ccf065f44e req-d5ff2f9e-2d59-4d42-ae88-041e4e15ea5f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051173 May 10 16:47:43.184655 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 220/409] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:47:43.278524 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-4d03e409-0e54-45bf-8e65-f0a806c68f26 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:43.288136 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-4d03e409-0e54-45bf-8e65-f0a806c68f26 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:43.298696 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-4d03e409-0e54-45bf-8e65-f0a806c68f26 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:43.298926 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-dc6b4f65-affd-4c30-95bc-f0d4e804a7c3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:43.299716 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-dc6b4f65-affd-4c30-95bc-f0d4e804a7c3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:43.302262 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-4d03e409-0e54-45bf-8e65-f0a806c68f26 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1665 microversion: 2.20 time: 0.348633 May 10 16:47:43.305570 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 190/410] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:42 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1665 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:43.325556 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b7b685a9-595d-431c-8884-388b2ec34e82 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a7febec-dcdb-4eb8-be30-8e1743b23dca"}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:43.329652 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-b7b685a9-595d-431c-8884-388b2ec34e82 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:43.331904 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc6b4f65-affd-4c30-95bc-f0d4e804a7c3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:43.344775 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc6b4f65-affd-4c30-95bc-f0d4e804a7c3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:43.345946 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc6b4f65-affd-4c30-95bc-f0d4e804a7c3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:43.346541 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc6b4f65-affd-4c30-95bc-f0d4e804a7c3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:43.364127 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b7b685a9-595d-431c-8884-388b2ec34e82 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:43.377112 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b7b685a9-595d-431c-8884-388b2ec34e82 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:43.379989 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b7b685a9-595d-431c-8884-388b2ec34e82 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:43.383540 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b7b685a9-595d-431c-8884-388b2ec34e82 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:43.742603 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-dc6b4f65-affd-4c30-95bc-f0d4e804a7c3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:43.750403 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-dc6b4f65-affd-4c30-95bc-f0d4e804a7c3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1318 microversion: 2.1 time: 0.456358 May 10 16:47:43.764953 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 221/411] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:43 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:43.780181 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-061ff4d4-3cea-40a5-a1cf-3702e278dde5 req-11e1d4b2-729e-4977-bc73-494c25d0a88a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b14b06-9428-41e6-ae67-68b253218e24", "tag": "fdeeb8a2-0f74-40ea-acb1-f138b641a2ce"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:43.795734 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-061ff4d4-3cea-40a5-a1cf-3702e278dde5 req-11e1d4b2-729e-4977-bc73-494c25d0a88a service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:43.797255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-061ff4d4-3cea-40a5-a1cf-3702e278dde5 req-11e1d4b2-729e-4977-bc73-494c25d0a88a service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:43.822058 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-061ff4d4-3cea-40a5-a1cf-3702e278dde5 req-11e1d4b2-729e-4977-bc73-494c25d0a88a service nova] Creating event network-changed:fdeeb8a2-0f74-40ea-acb1-f138b641a2ce for instance 25b14b06-9428-41e6-ae67-68b253218e24 on hv-cinder-84130 May 10 16:47:43.840556 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-061ff4d4-3cea-40a5-a1cf-3702e278dde5 req-11e1d4b2-729e-4977-bc73-494c25d0a88a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073095 May 10 16:47:43.841836 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 222/412] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:47:43.853086 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c3eeb8b6-dccc-4885-b877-ee1762fb1f54 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:43.854231 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c3eeb8b6-dccc-4885-b877-ee1762fb1f54 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:43.865594 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c3eeb8b6-dccc-4885-b877-ee1762fb1f54 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:43.866339 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c3eeb8b6-dccc-4885-b877-ee1762fb1f54 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:43.867357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c3eeb8b6-dccc-4885-b877-ee1762fb1f54 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:43.868107 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c3eeb8b6-dccc-4885-b877-ee1762fb1f54 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:43.918004 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b7b685a9-595d-431c-8884-388b2ec34e82 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "POST /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.599116 May 10 16:47:43.918616 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 191/413] 10.222.0.57 () {62 vars in 1363 bytes} [Tue May 10 16:47:43 2022] POST /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments => generated 188 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 16:47:43.982531 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-7b170b31-05f0-4721-b370-f42c9d34ccd9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:43.985949 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-7b170b31-05f0-4721-b370-f42c9d34ccd9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:44.006624 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7b170b31-05f0-4721-b370-f42c9d34ccd9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:44.009548 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7b170b31-05f0-4721-b370-f42c9d34ccd9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:44.011884 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7b170b31-05f0-4721-b370-f42c9d34ccd9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:44.014249 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7b170b31-05f0-4721-b370-f42c9d34ccd9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:44.150796 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7b170b31-05f0-4721-b370-f42c9d34ccd9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:44.158163 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-7b170b31-05f0-4721-b370-f42c9d34ccd9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1302 microversion: 2.1 time: 0.193036 May 10 16:47:44.158742 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 192/414] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:43 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1302 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:44.169378 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1550032a-c9be-4b2b-a190-764235254574 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:44.176068 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-1550032a-c9be-4b2b-a190-764235254574 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:44.187906 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1550032a-c9be-4b2b-a190-764235254574 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:44.188706 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1550032a-c9be-4b2b-a190-764235254574 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:44.191614 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1550032a-c9be-4b2b-a190-764235254574 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:44.193750 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1550032a-c9be-4b2b-a190-764235254574 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:44.259477 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c3eeb8b6-dccc-4885-b877-ee1762fb1f54 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:44.274292 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c3eeb8b6-dccc-4885-b877-ee1762fb1f54 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.430504 May 10 16:47:44.283110 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 223/415] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:43 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:44.294434 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e2b1aa6b-cac7-414b-a658-84f4a700a968 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:44.298380 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e2b1aa6b-cac7-414b-a658-84f4a700a968 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:44.311863 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e2b1aa6b-cac7-414b-a658-84f4a700a968 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:44.313230 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e2b1aa6b-cac7-414b-a658-84f4a700a968 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:44.317875 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e2b1aa6b-cac7-414b-a658-84f4a700a968 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:44.319942 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e2b1aa6b-cac7-414b-a658-84f4a700a968 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:44.408435 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-1550032a-c9be-4b2b-a190-764235254574 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "POST /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/action" status: 202 len: 0 microversion: 2.20 time: 0.244205 May 10 16:47:44.412582 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 193/416] 10.222.0.57 () {62 vars in 1318 bytes} [Tue May 10 16:47:44 2022] POST /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 16:47:44.421773 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-0fb444d5-724a-4ed0-92b9-beb233831c84 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:44.422780 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-0fb444d5-724a-4ed0-92b9-beb233831c84 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:44.432663 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0fb444d5-724a-4ed0-92b9-beb233831c84 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:44.440554 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0fb444d5-724a-4ed0-92b9-beb233831c84 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:44.444836 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0fb444d5-724a-4ed0-92b9-beb233831c84 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:44.446592 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0fb444d5-724a-4ed0-92b9-beb233831c84 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:44.580591 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e2b1aa6b-cac7-414b-a658-84f4a700a968 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:44.597677 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e2b1aa6b-cac7-414b-a658-84f4a700a968 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.309659 May 10 16:47:44.598927 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 224/417] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:44 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:44.716304 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-0fb444d5-724a-4ed0-92b9-beb233831c84 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:44.734547 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-0fb444d5-724a-4ed0-92b9-beb233831c84 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:44.736188 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-0fb444d5-724a-4ed0-92b9-beb233831c84 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:44.737698 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-0fb444d5-724a-4ed0-92b9-beb233831c84 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1751 microversion: 2.20 time: 0.320155 May 10 16:47:44.738605 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 194/418] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:44 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1751 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:47:44.769499 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ca11b230-8402-4c12-9c51-869d565e222a tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:44.770580 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ca11b230-8402-4c12-9c51-869d565e222a tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:44.782479 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ca11b230-8402-4c12-9c51-869d565e222a tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:44.784866 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ca11b230-8402-4c12-9c51-869d565e222a tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:44.787125 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ca11b230-8402-4c12-9c51-869d565e222a tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:44.789375 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ca11b230-8402-4c12-9c51-869d565e222a tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:45.115645 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ca11b230-8402-4c12-9c51-869d565e222a tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:45.133407 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ca11b230-8402-4c12-9c51-869d565e222a tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1318 microversion: 2.1 time: 0.368187 May 10 16:47:45.134009 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 225/419] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:44 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:45.176587 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-65f71b7a-1eab-4373-bc42-977568207f4b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:45.177199 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-65f71b7a-1eab-4373-bc42-977568207f4b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:45.212083 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-65f71b7a-1eab-4373-bc42-977568207f4b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:45.217836 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-65f71b7a-1eab-4373-bc42-977568207f4b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:45.220067 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-65f71b7a-1eab-4373-bc42-977568207f4b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:45.221976 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-65f71b7a-1eab-4373-bc42-977568207f4b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:45.294904 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-451939cf-3f58-4fa1-8b6c-073fec49284c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:45.295579 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-451939cf-3f58-4fa1-8b6c-073fec49284c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:45.302244 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-451939cf-3f58-4fa1-8b6c-073fec49284c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:45.302700 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-451939cf-3f58-4fa1-8b6c-073fec49284c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:45.303523 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-451939cf-3f58-4fa1-8b6c-073fec49284c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:45.303966 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-451939cf-3f58-4fa1-8b6c-073fec49284c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:45.730217 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-65f71b7a-1eab-4373-bc42-977568207f4b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:45.739410 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-65f71b7a-1eab-4373-bc42-977568207f4b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1369 microversion: 2.1 time: 0.567153 May 10 16:47:45.743999 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 195/420] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:45 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1369 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:45.750767 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-451939cf-3f58-4fa1-8b6c-073fec49284c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:45.760705 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-451939cf-3f58-4fa1-8b6c-073fec49284c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.469799 May 10 16:47:45.764782 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 226/421] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:45 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:45.767617 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-fcc82bec-41cb-414e-9d0e-f858c35d924a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:45.771655 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-fcc82bec-41cb-414e-9d0e-f858c35d924a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:45.775500 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-90439fdc-b7d1-4102-a2f2-1f4aabdf5929 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:45.780003 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-90439fdc-b7d1-4102-a2f2-1f4aabdf5929 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:45.784700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fcc82bec-41cb-414e-9d0e-f858c35d924a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:45.785342 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fcc82bec-41cb-414e-9d0e-f858c35d924a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:45.789569 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fcc82bec-41cb-414e-9d0e-f858c35d924a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:45.790257 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fcc82bec-41cb-414e-9d0e-f858c35d924a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:45.803390 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-90439fdc-b7d1-4102-a2f2-1f4aabdf5929 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:45.805064 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-90439fdc-b7d1-4102-a2f2-1f4aabdf5929 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:45.806357 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-90439fdc-b7d1-4102-a2f2-1f4aabdf5929 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:45.809726 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-90439fdc-b7d1-4102-a2f2-1f4aabdf5929 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:46.195489 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-90439fdc-b7d1-4102-a2f2-1f4aabdf5929 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:46.212132 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-90439fdc-b7d1-4102-a2f2-1f4aabdf5929 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:46.214295 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-90439fdc-b7d1-4102-a2f2-1f4aabdf5929 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:46.215718 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-90439fdc-b7d1-4102-a2f2-1f4aabdf5929 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1751 microversion: 2.20 time: 0.446727 May 10 16:47:46.217337 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 227/422] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:45 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1751 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:46.231151 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8bed462b-ba12-4378-9465-93230bf6d119 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:46.232017 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8bed462b-ba12-4378-9465-93230bf6d119 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:46.239155 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-fcc82bec-41cb-414e-9d0e-f858c35d924a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:46.244077 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8bed462b-ba12-4378-9465-93230bf6d119 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:46.244711 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8bed462b-ba12-4378-9465-93230bf6d119 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:46.245654 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8bed462b-ba12-4378-9465-93230bf6d119 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:46.246249 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8bed462b-ba12-4378-9465-93230bf6d119 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:46.249384 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-fcc82bec-41cb-414e-9d0e-f858c35d924a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.501444 May 10 16:47:46.250007 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 196/423] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:45 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:46.475019 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8bed462b-ba12-4378-9465-93230bf6d119 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:46.484409 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8bed462b-ba12-4378-9465-93230bf6d119 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1507 microversion: 2.1 time: 0.265808 May 10 16:47:46.495143 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 228/424] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:46 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1507 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:46.760990 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-48d5d77d-b723-49c0-b375-87a2aafcf468 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:46.761609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-48d5d77d-b723-49c0-b375-87a2aafcf468 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:46.773933 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-48d5d77d-b723-49c0-b375-87a2aafcf468 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:46.774386 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-48d5d77d-b723-49c0-b375-87a2aafcf468 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:46.776150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-48d5d77d-b723-49c0-b375-87a2aafcf468 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:46.776150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-48d5d77d-b723-49c0-b375-87a2aafcf468 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:46.781898 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e815a378-0d42-4601-853b-e7db8bfc47dd tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:46.782509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e815a378-0d42-4601-853b-e7db8bfc47dd tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:46.798194 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e815a378-0d42-4601-853b-e7db8bfc47dd tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:46.798648 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e815a378-0d42-4601-853b-e7db8bfc47dd tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:46.799472 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e815a378-0d42-4601-853b-e7db8bfc47dd tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:46.799906 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e815a378-0d42-4601-853b-e7db8bfc47dd tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:47.178938 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e815a378-0d42-4601-853b-e7db8bfc47dd tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:47.186943 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e815a378-0d42-4601-853b-e7db8bfc47dd tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.409480 May 10 16:47:47.192022 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 229/425] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:46 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:47.220133 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-48d5d77d-b723-49c0-b375-87a2aafcf468 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:47.241169 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-bf9f2876-d436-4106-b68d-ec5254dae788 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:47.241962 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-bf9f2876-d436-4106-b68d-ec5254dae788 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:47.244829 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-48d5d77d-b723-49c0-b375-87a2aafcf468 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1369 microversion: 2.1 time: 0.479513 May 10 16:47:47.248785 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bf9f2876-d436-4106-b68d-ec5254dae788 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:47.249979 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 197/426] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:46 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1369 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:47.252655 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bf9f2876-d436-4106-b68d-ec5254dae788 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:47.253751 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bf9f2876-d436-4106-b68d-ec5254dae788 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:47.254420 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bf9f2876-d436-4106-b68d-ec5254dae788 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:47.273432 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-0f155817-5171-4dfa-8670-71295adf5ecb tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:47.274398 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-0f155817-5171-4dfa-8670-71295adf5ecb tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:47.284463 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0f155817-5171-4dfa-8670-71295adf5ecb tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:47.285309 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0f155817-5171-4dfa-8670-71295adf5ecb tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:47.288453 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0f155817-5171-4dfa-8670-71295adf5ecb tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:47.292201 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0f155817-5171-4dfa-8670-71295adf5ecb tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:47.611192 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-bf9f2876-d436-4106-b68d-ec5254dae788 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:47.621792 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-0f155817-5171-4dfa-8670-71295adf5ecb tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:47.630475 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-0f155817-5171-4dfa-8670-71295adf5ecb tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.360837 May 10 16:47:47.635717 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-bf9f2876-d436-4106-b68d-ec5254dae788 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:47.637965 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 198/427] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:47 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:47.644280 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-bf9f2876-d436-4106-b68d-ec5254dae788 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:47.647633 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-bf9f2876-d436-4106-b68d-ec5254dae788 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1751 microversion: 2.20 time: 0.410265 May 10 16:47:47.658998 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 230/428] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:47 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1751 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:47:47.692275 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-b2dc10e8-0811-48b3-a8f2-28b8f6037d76 req-2722f330-c0a1-4e58-a2b7-fc5daac19746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be5fc929-1796-4c21-b41c-22850fb9939a", "tag": "043f55c8-7e1c-4a48-89b8-c52b9ab8066b"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:47.705523 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-b2dc10e8-0811-48b3-a8f2-28b8f6037d76 req-2722f330-c0a1-4e58-a2b7-fc5daac19746 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:47.712280 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-b2dc10e8-0811-48b3-a8f2-28b8f6037d76 req-2722f330-c0a1-4e58-a2b7-fc5daac19746 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:47.742315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-b2dc10e8-0811-48b3-a8f2-28b8f6037d76 req-2722f330-c0a1-4e58-a2b7-fc5daac19746 service nova] Creating event network-changed:043f55c8-7e1c-4a48-89b8-c52b9ab8066b for instance be5fc929-1796-4c21-b41c-22850fb9939a on hv-cinder-84130 May 10 16:47:47.750790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-b2dc10e8-0811-48b3-a8f2-28b8f6037d76 req-2722f330-c0a1-4e58-a2b7-fc5daac19746 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062101 May 10 16:47:47.752135 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 199/429] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:47:48.204474 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-849c9da8-584e-4787-a260-91da078d3b60 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:48.205087 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-849c9da8-584e-4787-a260-91da078d3b60 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:48.212881 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-849c9da8-584e-4787-a260-91da078d3b60 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:48.213333 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-849c9da8-584e-4787-a260-91da078d3b60 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:48.214129 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-849c9da8-584e-4787-a260-91da078d3b60 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:48.214746 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-849c9da8-584e-4787-a260-91da078d3b60 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:48.269164 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-ceb50927-c2c3-46f2-812f-69d15dab1055 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:48.270377 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-ceb50927-c2c3-46f2-812f-69d15dab1055 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:48.280958 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ceb50927-c2c3-46f2-812f-69d15dab1055 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:48.282318 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ceb50927-c2c3-46f2-812f-69d15dab1055 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:48.284122 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ceb50927-c2c3-46f2-812f-69d15dab1055 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:48.284760 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ceb50927-c2c3-46f2-812f-69d15dab1055 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:48.579584 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-849c9da8-584e-4787-a260-91da078d3b60 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:48.594938 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-849c9da8-584e-4787-a260-91da078d3b60 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.394057 May 10 16:47:48.600418 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 231/430] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:48 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:48.651082 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ceb50927-c2c3-46f2-812f-69d15dab1055 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:48.656064 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-45193cff-4da6-427c-a2f4-c56d825213fc tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:48.657798 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-45193cff-4da6-427c-a2f4-c56d825213fc tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:48.669401 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-ceb50927-c2c3-46f2-812f-69d15dab1055 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1369 microversion: 2.1 time: 0.406309 May 10 16:47:48.670845 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-45193cff-4da6-427c-a2f4-c56d825213fc tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:48.671452 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 200/431] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:48 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1369 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:48.671648 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-45193cff-4da6-427c-a2f4-c56d825213fc tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:48.672466 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-45193cff-4da6-427c-a2f4-c56d825213fc tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:48.674176 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-45193cff-4da6-427c-a2f4-c56d825213fc tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:48.680241 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-cc164288-8da8-447e-92fc-01675bdedeb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:48.681516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-cc164288-8da8-447e-92fc-01675bdedeb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:48.693703 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-cc164288-8da8-447e-92fc-01675bdedeb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:48.694807 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-cc164288-8da8-447e-92fc-01675bdedeb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:48.698557 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-cc164288-8da8-447e-92fc-01675bdedeb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:48.699418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-cc164288-8da8-447e-92fc-01675bdedeb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:48.903141 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-45193cff-4da6-427c-a2f4-c56d825213fc tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:48.911230 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-45193cff-4da6-427c-a2f4-c56d825213fc tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.261053 May 10 16:47:48.912454 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-cc164288-8da8-447e-92fc-01675bdedeb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:48.920693 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 232/432] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:48 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:48.924464 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-cc164288-8da8-447e-92fc-01675bdedeb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:48.926248 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-cc164288-8da8-447e-92fc-01675bdedeb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:48.927775 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-cc164288-8da8-447e-92fc-01675bdedeb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1753 microversion: 2.20 time: 0.254744 May 10 16:47:48.928317 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 201/433] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:48 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1753 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:49.620064 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b9e7f8ac-4231-4a5a-afde-2f9532d47507 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:49.622220 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b9e7f8ac-4231-4a5a-afde-2f9532d47507 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:49.630682 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b9e7f8ac-4231-4a5a-afde-2f9532d47507 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:49.631470 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b9e7f8ac-4231-4a5a-afde-2f9532d47507 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:49.632414 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b9e7f8ac-4231-4a5a-afde-2f9532d47507 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:49.632937 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b9e7f8ac-4231-4a5a-afde-2f9532d47507 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:49.714848 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1b1fcd21-483c-4d26-bcf3-94f10fe8d71e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:49.715486 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-1b1fcd21-483c-4d26-bcf3-94f10fe8d71e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:49.747645 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1b1fcd21-483c-4d26-bcf3-94f10fe8d71e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:49.748609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1b1fcd21-483c-4d26-bcf3-94f10fe8d71e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:49.749694 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1b1fcd21-483c-4d26-bcf3-94f10fe8d71e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:49.757793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1b1fcd21-483c-4d26-bcf3-94f10fe8d71e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:49.995035 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b9e7f8ac-4231-4a5a-afde-2f9532d47507 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:50.003280 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b9e7f8ac-4231-4a5a-afde-2f9532d47507 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.388742 May 10 16:47:50.003995 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 233/434] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:49 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:50.010907 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a00f219f-dad7-454b-9eab-e4f28904667b tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:50.011858 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a00f219f-dad7-454b-9eab-e4f28904667b tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:50.018943 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a00f219f-dad7-454b-9eab-e4f28904667b tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:50.019910 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a00f219f-dad7-454b-9eab-e4f28904667b tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:50.020960 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a00f219f-dad7-454b-9eab-e4f28904667b tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:50.021617 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a00f219f-dad7-454b-9eab-e4f28904667b tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:50.024690 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-1b1fcd21-483c-4d26-bcf3-94f10fe8d71e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:50.035776 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-1b1fcd21-483c-4d26-bcf3-94f10fe8d71e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1369 microversion: 2.1 time: 0.351623 May 10 16:47:50.037126 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 202/435] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:49 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1369 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:50.042393 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-827b4507-65f7-456a-9c0d-2e5fe35695ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:50.043379 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-827b4507-65f7-456a-9c0d-2e5fe35695ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:50.052632 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-827b4507-65f7-456a-9c0d-2e5fe35695ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:50.052923 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-827b4507-65f7-456a-9c0d-2e5fe35695ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:50.053604 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-827b4507-65f7-456a-9c0d-2e5fe35695ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:50.054048 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-827b4507-65f7-456a-9c0d-2e5fe35695ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:50.493277 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a00f219f-dad7-454b-9eab-e4f28904667b tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:50.501011 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a00f219f-dad7-454b-9eab-e4f28904667b tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.495719 May 10 16:47:50.510057 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 234/436] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:50 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:50.512279 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-827b4507-65f7-456a-9c0d-2e5fe35695ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:50.522291 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-827b4507-65f7-456a-9c0d-2e5fe35695ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:50.523935 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-827b4507-65f7-456a-9c0d-2e5fe35695ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:50.525122 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-827b4507-65f7-456a-9c0d-2e5fe35695ed tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1753 microversion: 2.20 time: 0.486724 May 10 16:47:50.525949 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 203/437] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:50 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1753 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:51.022058 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d2c5dd92-40a3-4ec2-9026-c4bd51be5ab9 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:51.022719 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d2c5dd92-40a3-4ec2-9026-c4bd51be5ab9 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:51.030830 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d2c5dd92-40a3-4ec2-9026-c4bd51be5ab9 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:51.031320 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d2c5dd92-40a3-4ec2-9026-c4bd51be5ab9 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:51.032138 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d2c5dd92-40a3-4ec2-9026-c4bd51be5ab9 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:51.032589 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d2c5dd92-40a3-4ec2-9026-c4bd51be5ab9 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:51.053369 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-2399dcf8-eee9-435d-a666-b380ac2385da tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:51.053983 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-2399dcf8-eee9-435d-a666-b380ac2385da tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:51.059989 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2399dcf8-eee9-435d-a666-b380ac2385da tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:51.060763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2399dcf8-eee9-435d-a666-b380ac2385da tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:51.061756 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2399dcf8-eee9-435d-a666-b380ac2385da tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:51.062190 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2399dcf8-eee9-435d-a666-b380ac2385da tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:51.258915 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d2c5dd92-40a3-4ec2-9026-c4bd51be5ab9 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:51.262256 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-2399dcf8-eee9-435d-a666-b380ac2385da tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:51.275135 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-2399dcf8-eee9-435d-a666-b380ac2385da tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1369 microversion: 2.1 time: 0.225940 May 10 16:47:51.275963 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 204/438] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:51 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1369 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:51.276877 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d2c5dd92-40a3-4ec2-9026-c4bd51be5ab9 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.259425 May 10 16:47:51.278273 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 235/439] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:51 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:51.518515 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-c6b9e2b9-13f4-4d26-956a-1b390473f42a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:51.518866 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-c6b9e2b9-13f4-4d26-956a-1b390473f42a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:51.525121 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c6b9e2b9-13f4-4d26-956a-1b390473f42a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:51.525631 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c6b9e2b9-13f4-4d26-956a-1b390473f42a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:51.526340 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c6b9e2b9-13f4-4d26-956a-1b390473f42a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:51.527168 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c6b9e2b9-13f4-4d26-956a-1b390473f42a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:51.545884 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-cd58dd90-0736-4f84-9f9f-bff3d2c99576 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:51.546511 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-cd58dd90-0736-4f84-9f9f-bff3d2c99576 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:51.555248 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cd58dd90-0736-4f84-9f9f-bff3d2c99576 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:51.555747 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cd58dd90-0736-4f84-9f9f-bff3d2c99576 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:51.556631 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cd58dd90-0736-4f84-9f9f-bff3d2c99576 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:51.557296 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cd58dd90-0736-4f84-9f9f-bff3d2c99576 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:51.747361 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c6b9e2b9-13f4-4d26-956a-1b390473f42a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:51.768737 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-c6b9e2b9-13f4-4d26-956a-1b390473f42a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.254852 May 10 16:47:51.769490 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 205/440] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:51 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:51.773632 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-cd58dd90-0736-4f84-9f9f-bff3d2c99576 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:51.784182 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-cd58dd90-0736-4f84-9f9f-bff3d2c99576 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:51.785880 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-cd58dd90-0736-4f84-9f9f-bff3d2c99576 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:51.787218 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-cd58dd90-0736-4f84-9f9f-bff3d2c99576 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.247442 May 10 16:47:51.798475 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 236/441] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:51 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:47:52.296454 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8c42d8c8-b489-45ea-bc66-17f848c9d759 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:52.297417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-97c14768-6367-45e1-a153-889af3aaf454 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:52.298062 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-97c14768-6367-45e1-a153-889af3aaf454 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:52.298985 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8c42d8c8-b489-45ea-bc66-17f848c9d759 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:52.306835 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-97c14768-6367-45e1-a153-889af3aaf454 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:52.308783 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-97c14768-6367-45e1-a153-889af3aaf454 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:52.312699 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-97c14768-6367-45e1-a153-889af3aaf454 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:52.314747 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-97c14768-6367-45e1-a153-889af3aaf454 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:52.325562 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8c42d8c8-b489-45ea-bc66-17f848c9d759 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:52.329661 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8c42d8c8-b489-45ea-bc66-17f848c9d759 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:52.330741 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8c42d8c8-b489-45ea-bc66-17f848c9d759 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:52.338936 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8c42d8c8-b489-45ea-bc66-17f848c9d759 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:52.591285 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-97c14768-6367-45e1-a153-889af3aaf454 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:52.599827 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-97c14768-6367-45e1-a153-889af3aaf454 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1369 microversion: 2.1 time: 0.309217 May 10 16:47:52.611694 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 206/442] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:52 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1369 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:52.644560 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8c42d8c8-b489-45ea-bc66-17f848c9d759 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:52.652829 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8c42d8c8-b489-45ea-bc66-17f848c9d759 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.362068 May 10 16:47:52.671524 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 237/443] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:52 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:52.787347 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-d026a954-cecc-4f9b-935c-6311eb712062 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:52.792761 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-d026a954-cecc-4f9b-935c-6311eb712062 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:52.800092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d026a954-cecc-4f9b-935c-6311eb712062 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:52.805424 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-237f002a-3049-4465-9b16-5b613d70136b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:52.806115 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-237f002a-3049-4465-9b16-5b613d70136b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:52.811598 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d026a954-cecc-4f9b-935c-6311eb712062 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:52.813210 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d026a954-cecc-4f9b-935c-6311eb712062 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:52.813729 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d026a954-cecc-4f9b-935c-6311eb712062 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:52.818070 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-237f002a-3049-4465-9b16-5b613d70136b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:52.819114 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-237f002a-3049-4465-9b16-5b613d70136b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:52.819931 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-237f002a-3049-4465-9b16-5b613d70136b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:52.820371 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-237f002a-3049-4465-9b16-5b613d70136b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:53.043980 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-d026a954-cecc-4f9b-935c-6311eb712062 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:53.055765 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-237f002a-3049-4465-9b16-5b613d70136b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:53.061622 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-d026a954-cecc-4f9b-935c-6311eb712062 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.274650 May 10 16:47:53.063224 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 207/444] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:52 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:53.067517 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-237f002a-3049-4465-9b16-5b613d70136b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:53.069582 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-237f002a-3049-4465-9b16-5b613d70136b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:53.070783 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-237f002a-3049-4465-9b16-5b613d70136b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.269136 May 10 16:47:53.072177 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 238/445] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:52 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:53.619646 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-c5909f12-ee5a-4dbd-8182-2531d18573ec tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:53.620634 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-c5909f12-ee5a-4dbd-8182-2531d18573ec tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:53.629136 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c5909f12-ee5a-4dbd-8182-2531d18573ec tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:53.629969 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c5909f12-ee5a-4dbd-8182-2531d18573ec tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:53.630759 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c5909f12-ee5a-4dbd-8182-2531d18573ec tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:53.631322 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c5909f12-ee5a-4dbd-8182-2531d18573ec tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:53.676453 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d4fb733e-71df-48f8-8468-c033d7abc3be tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:53.677042 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d4fb733e-71df-48f8-8468-c033d7abc3be tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:53.684364 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d4fb733e-71df-48f8-8468-c033d7abc3be tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:53.684558 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d4fb733e-71df-48f8-8468-c033d7abc3be tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:53.685356 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d4fb733e-71df-48f8-8468-c033d7abc3be tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:53.686787 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d4fb733e-71df-48f8-8468-c033d7abc3be tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:53.889255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c5909f12-ee5a-4dbd-8182-2531d18573ec tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:53.897997 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-c5909f12-ee5a-4dbd-8182-2531d18573ec tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1369 microversion: 2.1 time: 0.282642 May 10 16:47:53.905114 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d4fb733e-71df-48f8-8468-c033d7abc3be tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:53.908899 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 208/446] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:53 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1369 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:53.912848 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d4fb733e-71df-48f8-8468-c033d7abc3be tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.240954 May 10 16:47:53.914443 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 239/447] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:53 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:54.079984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-aef5076a-2c80-440e-8b76-ed0c40c78d2a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:54.080935 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-aef5076a-2c80-440e-8b76-ed0c40c78d2a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:54.091303 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-aef5076a-2c80-440e-8b76-ed0c40c78d2a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:54.093182 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-aef5076a-2c80-440e-8b76-ed0c40c78d2a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:54.094275 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-aef5076a-2c80-440e-8b76-ed0c40c78d2a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:54.094589 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-97980fbc-b4f2-4d3e-8032-c63ba616382b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:54.095101 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-aef5076a-2c80-440e-8b76-ed0c40c78d2a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:54.095882 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-97980fbc-b4f2-4d3e-8032-c63ba616382b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:54.104682 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-97980fbc-b4f2-4d3e-8032-c63ba616382b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:54.105159 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-97980fbc-b4f2-4d3e-8032-c63ba616382b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:54.106428 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-97980fbc-b4f2-4d3e-8032-c63ba616382b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:54.106791 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-97980fbc-b4f2-4d3e-8032-c63ba616382b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:54.354388 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-97980fbc-b4f2-4d3e-8032-c63ba616382b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:54.358813 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-aef5076a-2c80-440e-8b76-ed0c40c78d2a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:54.367426 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-aef5076a-2c80-440e-8b76-ed0c40c78d2a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.291181 May 10 16:47:54.368008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 209/448] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:54 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:54.376286 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-97980fbc-b4f2-4d3e-8032-c63ba616382b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:54.377800 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-97980fbc-b4f2-4d3e-8032-c63ba616382b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:54.380223 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-97980fbc-b4f2-4d3e-8032-c63ba616382b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.294305 May 10 16:47:54.381149 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 240/449] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:54 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:54.920456 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-2a145077-ca68-4807-8249-51fba9bdfcf1 req-a12aa5f1-4b3e-482e-a624-e87af4221e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5fc929-1796-4c21-b41c-22850fb9939a", "name": "network-vif-plugged", "status": "completed", "tag": "043f55c8-7e1c-4a48-89b8-c52b9ab8066b"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:54.921185 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-0923e572-a93a-4e00-a9eb-2cf313578204 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:54.921696 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-0923e572-a93a-4e00-a9eb-2cf313578204 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:54.930410 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0923e572-a93a-4e00-a9eb-2cf313578204 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:54.930867 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0923e572-a93a-4e00-a9eb-2cf313578204 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:54.931878 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0923e572-a93a-4e00-a9eb-2cf313578204 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:54.932763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0923e572-a93a-4e00-a9eb-2cf313578204 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:54.938838 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-2a145077-ca68-4807-8249-51fba9bdfcf1 req-a12aa5f1-4b3e-482e-a624-e87af4221e66 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:54.939497 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-2a145077-ca68-4807-8249-51fba9bdfcf1 req-a12aa5f1-4b3e-482e-a624-e87af4221e66 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:54.957089 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-2a145077-ca68-4807-8249-51fba9bdfcf1 req-a12aa5f1-4b3e-482e-a624-e87af4221e66 service nova] Creating event network-vif-plugged:043f55c8-7e1c-4a48-89b8-c52b9ab8066b for instance be5fc929-1796-4c21-b41c-22850fb9939a on hv-cinder-84130 May 10 16:47:54.965252 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-2a145077-ca68-4807-8249-51fba9bdfcf1 req-a12aa5f1-4b3e-482e-a624-e87af4221e66 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048618 May 10 16:47:54.966794 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 241/450] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:47:54.974104 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-48b74e53-6458-4493-a7e1-dbfb498a386e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:54.975437 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-48b74e53-6458-4493-a7e1-dbfb498a386e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:54.986114 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-48b74e53-6458-4493-a7e1-dbfb498a386e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:54.987023 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-48b74e53-6458-4493-a7e1-dbfb498a386e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:54.988389 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-48b74e53-6458-4493-a7e1-dbfb498a386e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:54.989087 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-48b74e53-6458-4493-a7e1-dbfb498a386e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:55.200201 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-0923e572-a93a-4e00-a9eb-2cf313578204 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:55.208355 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-0923e572-a93a-4e00-a9eb-2cf313578204 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1369 microversion: 2.1 time: 0.295568 May 10 16:47:55.213259 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 210/451] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:54 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1369 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:55.238498 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-48b74e53-6458-4493-a7e1-dbfb498a386e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:55.250874 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-48b74e53-6458-4493-a7e1-dbfb498a386e tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.281372 May 10 16:47:55.251759 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 242/452] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:54 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:55.383688 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-3554720d-d676-4944-a79a-ba4a375719b0 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:55.384409 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-3554720d-d676-4944-a79a-ba4a375719b0 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:55.407746 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2f284bca-6176-454e-b5a8-421eadee461c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:55.408717 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3554720d-d676-4944-a79a-ba4a375719b0 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:55.409249 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3554720d-d676-4944-a79a-ba4a375719b0 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:55.409809 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2f284bca-6176-454e-b5a8-421eadee461c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:55.410168 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3554720d-d676-4944-a79a-ba4a375719b0 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:55.410734 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3554720d-d676-4944-a79a-ba4a375719b0 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:55.423300 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2f284bca-6176-454e-b5a8-421eadee461c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:55.424898 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2f284bca-6176-454e-b5a8-421eadee461c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:55.426632 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2f284bca-6176-454e-b5a8-421eadee461c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:55.429047 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2f284bca-6176-454e-b5a8-421eadee461c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:55.670593 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-3554720d-d676-4944-a79a-ba4a375719b0 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:55.678686 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-3554720d-d676-4944-a79a-ba4a375719b0 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.298964 May 10 16:47:55.679724 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 211/453] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:55 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:55.704195 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2f284bca-6176-454e-b5a8-421eadee461c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:55.719674 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2f284bca-6176-454e-b5a8-421eadee461c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:55.721512 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2f284bca-6176-454e-b5a8-421eadee461c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:55.722934 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2f284bca-6176-454e-b5a8-421eadee461c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.327038 May 10 16:47:55.723790 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 243/454] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:55 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:47:56.229059 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-68eee52a-a629-4cca-980e-f75eeb78c960 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:56.229772 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-68eee52a-a629-4cca-980e-f75eeb78c960 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:56.237540 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-68eee52a-a629-4cca-980e-f75eeb78c960 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:56.238027 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-68eee52a-a629-4cca-980e-f75eeb78c960 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:56.238796 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-68eee52a-a629-4cca-980e-f75eeb78c960 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:56.239253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-68eee52a-a629-4cca-980e-f75eeb78c960 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:56.269092 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5313100a-f054-47e8-b2cc-9f2aafe8e021 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:56.269971 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5313100a-f054-47e8-b2cc-9f2aafe8e021 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:56.276344 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5313100a-f054-47e8-b2cc-9f2aafe8e021 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:56.276877 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5313100a-f054-47e8-b2cc-9f2aafe8e021 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:56.277721 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5313100a-f054-47e8-b2cc-9f2aafe8e021 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:56.278364 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5313100a-f054-47e8-b2cc-9f2aafe8e021 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:56.427534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-68eee52a-a629-4cca-980e-f75eeb78c960 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:56.443080 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-68eee52a-a629-4cca-980e-f75eeb78c960 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1369 microversion: 2.1 time: 0.217910 May 10 16:47:56.443676 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 212/455] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:56 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:56.459950 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-5313100a-f054-47e8-b2cc-9f2aafe8e021 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:56.468919 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5313100a-f054-47e8-b2cc-9f2aafe8e021 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.203682 May 10 16:47:56.469768 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 244/456] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:56 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:47:56.696156 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-32a71ce2-66a6-46c6-85d9-0e896c6e82d8 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:56.697102 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-32a71ce2-66a6-46c6-85d9-0e896c6e82d8 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:56.703955 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-32a71ce2-66a6-46c6-85d9-0e896c6e82d8 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:56.704398 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-32a71ce2-66a6-46c6-85d9-0e896c6e82d8 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:56.705189 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-32a71ce2-66a6-46c6-85d9-0e896c6e82d8 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:56.705633 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-32a71ce2-66a6-46c6-85d9-0e896c6e82d8 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:56.742883 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a22a0f18-5ddc-47fc-9b3d-f4a118e68f62 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:56.744085 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a22a0f18-5ddc-47fc-9b3d-f4a118e68f62 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:56.751585 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a22a0f18-5ddc-47fc-9b3d-f4a118e68f62 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:56.752373 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a22a0f18-5ddc-47fc-9b3d-f4a118e68f62 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:56.753612 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a22a0f18-5ddc-47fc-9b3d-f4a118e68f62 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:56.754313 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a22a0f18-5ddc-47fc-9b3d-f4a118e68f62 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:56.928124 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-32a71ce2-66a6-46c6-85d9-0e896c6e82d8 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:56.938944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-32a71ce2-66a6-46c6-85d9-0e896c6e82d8 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.246547 May 10 16:47:56.944108 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 213/457] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:56 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:56.973782 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a22a0f18-5ddc-47fc-9b3d-f4a118e68f62 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:56.984047 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a22a0f18-5ddc-47fc-9b3d-f4a118e68f62 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:56.985869 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a22a0f18-5ddc-47fc-9b3d-f4a118e68f62 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:56.987289 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a22a0f18-5ddc-47fc-9b3d-f4a118e68f62 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.249529 May 10 16:47:56.988756 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 245/458] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:56 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:47:57.001080 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-42965a0e-d6f7-4465-9c1b-ac456c71e262 req-4b8bff72-35e0-46c2-8825-cf9c8bda79ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "256c0577-62c0-4b3f-bc59-3171e7928b0c", "name": "network-vif-plugged", "status": "completed", "tag": "7f137a16-3c79-4550-b56b-4ded57073eee"}, {"server_uuid": "25b14b06-9428-41e6-ae67-68b253218e24", "name": "network-vif-plugged", "status": "completed", "tag": "fdeeb8a2-0f74-40ea-acb1-f138b641a2ce"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:57.009970 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-42965a0e-d6f7-4465-9c1b-ac456c71e262 req-4b8bff72-35e0-46c2-8825-cf9c8bda79ad service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:57.010418 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-42965a0e-d6f7-4465-9c1b-ac456c71e262 req-4b8bff72-35e0-46c2-8825-cf9c8bda79ad service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:57.023847 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-42965a0e-d6f7-4465-9c1b-ac456c71e262 req-4b8bff72-35e0-46c2-8825-cf9c8bda79ad service nova] Creating event network-vif-plugged:7f137a16-3c79-4550-b56b-4ded57073eee for instance 256c0577-62c0-4b3f-bc59-3171e7928b0c on hv-cinder-84130 May 10 16:47:57.024491 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-42965a0e-d6f7-4465-9c1b-ac456c71e262 req-4b8bff72-35e0-46c2-8825-cf9c8bda79ad service nova] Creating event network-vif-plugged:fdeeb8a2-0f74-40ea-acb1-f138b641a2ce for instance 25b14b06-9428-41e6-ae67-68b253218e24 on hv-cinder-84130 May 10 16:47:57.031714 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-42965a0e-d6f7-4465-9c1b-ac456c71e262 req-4b8bff72-35e0-46c2-8825-cf9c8bda79ad service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034762 May 10 16:47:57.036097 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 214/459] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:47:57.460293 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-16a9502d-12c1-4d14-8cbe-23cb094d5fc4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:57.460898 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-16a9502d-12c1-4d14-8cbe-23cb094d5fc4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:57.467342 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-16a9502d-12c1-4d14-8cbe-23cb094d5fc4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:57.468014 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-16a9502d-12c1-4d14-8cbe-23cb094d5fc4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:57.468960 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-16a9502d-12c1-4d14-8cbe-23cb094d5fc4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:57.469552 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-16a9502d-12c1-4d14-8cbe-23cb094d5fc4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:57.490426 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-74636a60-5918-4e74-9273-c4e13e7f78b8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:57.491156 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-74636a60-5918-4e74-9273-c4e13e7f78b8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:57.509604 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-74636a60-5918-4e74-9273-c4e13e7f78b8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:57.510329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-74636a60-5918-4e74-9273-c4e13e7f78b8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:57.511302 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-74636a60-5918-4e74-9273-c4e13e7f78b8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:57.511884 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-74636a60-5918-4e74-9273-c4e13e7f78b8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:57.725947 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-16a9502d-12c1-4d14-8cbe-23cb094d5fc4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:57.740630 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-16a9502d-12c1-4d14-8cbe-23cb094d5fc4 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1563 microversion: 2.1 time: 0.283616 May 10 16:47:57.743168 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 246/460] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:57 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1563 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:57.757373 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-74636a60-5918-4e74-9273-c4e13e7f78b8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:57.760671 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-426ac68a-23a1-4f6e-935e-d9ae85411569 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:57.761407 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-426ac68a-23a1-4f6e-935e-d9ae85411569 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:57.765320 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-74636a60-5918-4e74-9273-c4e13e7f78b8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.279870 May 10 16:47:57.774998 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-426ac68a-23a1-4f6e-935e-d9ae85411569 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:57.774998 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-426ac68a-23a1-4f6e-935e-d9ae85411569 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:57.775306 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 215/461] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:57 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:57.775391 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-426ac68a-23a1-4f6e-935e-d9ae85411569 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:57.775391 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-426ac68a-23a1-4f6e-935e-d9ae85411569 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:57.861328 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-426ac68a-23a1-4f6e-935e-d9ae85411569 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104747 May 10 16:47:57.861928 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 247/462] 10.222.0.57 () {58 vars in 1274 bytes} [Tue May 10 16:47:57 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:47:57.961478 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-865250fb-322b-4281-b89a-36762241b3de tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:57.962104 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-865250fb-322b-4281-b89a-36762241b3de tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:57.974155 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-865250fb-322b-4281-b89a-36762241b3de tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:57.974614 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-865250fb-322b-4281-b89a-36762241b3de tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:57.982896 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-865250fb-322b-4281-b89a-36762241b3de tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:57.983823 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-865250fb-322b-4281-b89a-36762241b3de tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:58.015623 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b2e21227-d0a3-4032-894f-b1159d2a4912 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:58.016279 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b2e21227-d0a3-4032-894f-b1159d2a4912 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:58.022591 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b2e21227-d0a3-4032-894f-b1159d2a4912 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:58.023050 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b2e21227-d0a3-4032-894f-b1159d2a4912 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:58.023877 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b2e21227-d0a3-4032-894f-b1159d2a4912 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:58.024325 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b2e21227-d0a3-4032-894f-b1159d2a4912 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:58.377638 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-865250fb-322b-4281-b89a-36762241b3de tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:58.389664 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-865250fb-322b-4281-b89a-36762241b3de tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.431556 May 10 16:47:58.391758 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 216/463] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:57 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:58.416224 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b2e21227-d0a3-4032-894f-b1159d2a4912 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:58.428909 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b2e21227-d0a3-4032-894f-b1159d2a4912 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:58.430705 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b2e21227-d0a3-4032-894f-b1159d2a4912 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:58.432668 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b2e21227-d0a3-4032-894f-b1159d2a4912 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.430503 May 10 16:47:58.433769 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 248/464] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:58 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:47:58.783583 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-6db843ef-ec69-45c4-b0a7-cd320af0fb36 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:58.784256 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-6db843ef-ec69-45c4-b0a7-cd320af0fb36 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:58.792973 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6db843ef-ec69-45c4-b0a7-cd320af0fb36 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:58.795513 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6db843ef-ec69-45c4-b0a7-cd320af0fb36 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:58.797509 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6db843ef-ec69-45c4-b0a7-cd320af0fb36 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:58.798758 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6db843ef-ec69-45c4-b0a7-cd320af0fb36 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:59.089440 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6db843ef-ec69-45c4-b0a7-cd320af0fb36 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:59.102873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-6db843ef-ec69-45c4-b0a7-cd320af0fb36 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.323106 May 10 16:47:59.103927 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 217/465] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:58 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:59.408223 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6cdff258-69c7-4990-aaf1-c18be5f7fa12 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:59.409166 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6cdff258-69c7-4990-aaf1-c18be5f7fa12 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:59.415384 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6cdff258-69c7-4990-aaf1-c18be5f7fa12 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:59.415955 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6cdff258-69c7-4990-aaf1-c18be5f7fa12 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:59.416879 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6cdff258-69c7-4990-aaf1-c18be5f7fa12 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:59.417401 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6cdff258-69c7-4990-aaf1-c18be5f7fa12 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:59.454515 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-c93988f2-f885-4204-8540-01d9afd8ae56 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:47:59.455342 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-c93988f2-f885-4204-8540-01d9afd8ae56 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:47:59.464205 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c93988f2-f885-4204-8540-01d9afd8ae56 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:59.464974 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c93988f2-f885-4204-8540-01d9afd8ae56 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:59.467107 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c93988f2-f885-4204-8540-01d9afd8ae56 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:59.468726 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c93988f2-f885-4204-8540-01d9afd8ae56 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:59.783554 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6cdff258-69c7-4990-aaf1-c18be5f7fa12 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:59.786744 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c93988f2-f885-4204-8540-01d9afd8ae56 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:59.813427 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6cdff258-69c7-4990-aaf1-c18be5f7fa12 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.409348 May 10 16:47:59.822410 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c93988f2-f885-4204-8540-01d9afd8ae56 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:59.822640 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 249/466] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:47:59 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:47:59.822737 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c93988f2-f885-4204-8540-01d9afd8ae56 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:47:59.822737 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-c93988f2-f885-4204-8540-01d9afd8ae56 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.369763 May 10 16:47:59.823619 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 218/467] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:47:59 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:47:59.824847 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-a0f0aa1a-9195-43dc-b10e-c0af699b72d4 req-0a95487a-8516-4949-b729-d04f10f562cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be5fc929-1796-4c21-b41c-22850fb9939a", "tag": "043f55c8-7e1c-4a48-89b8-c52b9ab8066b"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:47:59.834769 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-a0f0aa1a-9195-43dc-b10e-c0af699b72d4 req-0a95487a-8516-4949-b729-d04f10f562cc service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:47:59.835246 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-a0f0aa1a-9195-43dc-b10e-c0af699b72d4 req-0a95487a-8516-4949-b729-d04f10f562cc service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:47:59.851430 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-a0f0aa1a-9195-43dc-b10e-c0af699b72d4 req-0a95487a-8516-4949-b729-d04f10f562cc service nova] Creating event network-changed:043f55c8-7e1c-4a48-89b8-c52b9ab8066b for instance be5fc929-1796-4c21-b41c-22850fb9939a on hv-cinder-84130 May 10 16:47:59.868272 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-a0f0aa1a-9195-43dc-b10e-c0af699b72d4 req-0a95487a-8516-4949-b729-d04f10f562cc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049773 May 10 16:47:59.868983 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 250/468] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:48:00.120684 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-891ec27f-eefd-4130-aa8b-2c2ae2bf8f40 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:00.121299 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-891ec27f-eefd-4130-aa8b-2c2ae2bf8f40 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:00.127518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-891ec27f-eefd-4130-aa8b-2c2ae2bf8f40 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:00.127973 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-891ec27f-eefd-4130-aa8b-2c2ae2bf8f40 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:00.128768 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-891ec27f-eefd-4130-aa8b-2c2ae2bf8f40 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:00.129209 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-891ec27f-eefd-4130-aa8b-2c2ae2bf8f40 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:00.317333 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-891ec27f-eefd-4130-aa8b-2c2ae2bf8f40 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:00.328762 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-891ec27f-eefd-4130-aa8b-2c2ae2bf8f40 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.211744 May 10 16:48:00.338667 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 219/469] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:00 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:00.832344 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-837b08f7-9945-49b4-b3f3-ed9b755a9128 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:00.832344 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-837b08f7-9945-49b4-b3f3-ed9b755a9128 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:00.842450 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-96614338-2a4d-4876-b98c-8ee0a8787904 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:00.842450 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-96614338-2a4d-4876-b98c-8ee0a8787904 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:00.851717 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-96614338-2a4d-4876-b98c-8ee0a8787904 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:00.854018 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-837b08f7-9945-49b4-b3f3-ed9b755a9128 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:00.854580 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-96614338-2a4d-4876-b98c-8ee0a8787904 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:00.855535 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-96614338-2a4d-4876-b98c-8ee0a8787904 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:00.856089 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-837b08f7-9945-49b4-b3f3-ed9b755a9128 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:00.858811 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-96614338-2a4d-4876-b98c-8ee0a8787904 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:00.859875 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-837b08f7-9945-49b4-b3f3-ed9b755a9128 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:00.861781 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-837b08f7-9945-49b4-b3f3-ed9b755a9128 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:01.197580 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-837b08f7-9945-49b4-b3f3-ed9b755a9128 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:01.204358 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-96614338-2a4d-4876-b98c-8ee0a8787904 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:01.226197 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-837b08f7-9945-49b4-b3f3-ed9b755a9128 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.400050 May 10 16:48:01.229311 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-96614338-2a4d-4876-b98c-8ee0a8787904 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:01.230582 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 251/470] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:00 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:01.233754 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-96614338-2a4d-4876-b98c-8ee0a8787904 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:01.235323 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-96614338-2a4d-4876-b98c-8ee0a8787904 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.400834 May 10 16:48:01.251109 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 220/471] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:00 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:48:01.346372 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8c3a485d-2184-4502-826b-a0c3ecb012de tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:01.347097 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8c3a485d-2184-4502-826b-a0c3ecb012de tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:01.363786 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8c3a485d-2184-4502-826b-a0c3ecb012de tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:01.364287 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8c3a485d-2184-4502-826b-a0c3ecb012de tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:01.365041 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8c3a485d-2184-4502-826b-a0c3ecb012de tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:01.365486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8c3a485d-2184-4502-826b-a0c3ecb012de tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:01.540602 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8c3a485d-2184-4502-826b-a0c3ecb012de tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:01.552579 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8c3a485d-2184-4502-826b-a0c3ecb012de tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.210865 May 10 16:48:01.562600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 252/472] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:01 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:02.247410 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-6e84ad42-a5a4-4367-8273-6c08dac7ae72 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:02.248057 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-6e84ad42-a5a4-4367-8273-6c08dac7ae72 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:02.260516 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9abf1ce5-a4bf-4f93-8d95-0273f59493f3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:02.261732 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6e84ad42-a5a4-4367-8273-6c08dac7ae72 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:02.262253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6e84ad42-a5a4-4367-8273-6c08dac7ae72 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:02.262622 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9abf1ce5-a4bf-4f93-8d95-0273f59493f3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:02.263237 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6e84ad42-a5a4-4367-8273-6c08dac7ae72 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:02.263742 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6e84ad42-a5a4-4367-8273-6c08dac7ae72 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:02.269851 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9abf1ce5-a4bf-4f93-8d95-0273f59493f3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:02.270828 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9abf1ce5-a4bf-4f93-8d95-0273f59493f3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:02.272735 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9abf1ce5-a4bf-4f93-8d95-0273f59493f3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:02.273375 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9abf1ce5-a4bf-4f93-8d95-0273f59493f3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:02.577195 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6e84ad42-a5a4-4367-8273-6c08dac7ae72 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:02.588539 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-6e84ad42-a5a4-4367-8273-6c08dac7ae72 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.347036 May 10 16:48:02.591003 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9abf1ce5-a4bf-4f93-8d95-0273f59493f3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:02.595578 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 221/473] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:02 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:02.600803 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-4eecc844-138d-4dc3-894a-25d71459a13d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:02.601628 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-4eecc844-138d-4dc3-894a-25d71459a13d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:02.608100 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4eecc844-138d-4dc3-894a-25d71459a13d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:02.608828 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4eecc844-138d-4dc3-894a-25d71459a13d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:02.609794 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4eecc844-138d-4dc3-894a-25d71459a13d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:02.610394 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4eecc844-138d-4dc3-894a-25d71459a13d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:02.611439 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9abf1ce5-a4bf-4f93-8d95-0273f59493f3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:02.613637 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9abf1ce5-a4bf-4f93-8d95-0273f59493f3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:02.615684 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9abf1ce5-a4bf-4f93-8d95-0273f59493f3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.359335 May 10 16:48:02.627043 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 253/474] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:02 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:02.769979 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-4eecc844-138d-4dc3-894a-25d71459a13d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:02.777607 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-4eecc844-138d-4dc3-894a-25d71459a13d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.180755 May 10 16:48:02.787458 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 222/475] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:02 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:03.613047 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-182305fc-dc1a-40d9-b729-6413b0150570 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:03.613741 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-182305fc-dc1a-40d9-b729-6413b0150570 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:03.634691 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-8c85d9c1-4e2d-4c17-8f55-2bd96db46826 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:03.635480 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-8c85d9c1-4e2d-4c17-8f55-2bd96db46826 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:03.644081 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-182305fc-dc1a-40d9-b729-6413b0150570 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:03.644527 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-182305fc-dc1a-40d9-b729-6413b0150570 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:03.645301 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-182305fc-dc1a-40d9-b729-6413b0150570 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:03.645730 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-182305fc-dc1a-40d9-b729-6413b0150570 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:03.650371 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8c85d9c1-4e2d-4c17-8f55-2bd96db46826 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:03.650819 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8c85d9c1-4e2d-4c17-8f55-2bd96db46826 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:03.651623 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8c85d9c1-4e2d-4c17-8f55-2bd96db46826 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:03.652065 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8c85d9c1-4e2d-4c17-8f55-2bd96db46826 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:03.922793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-8c85d9c1-4e2d-4c17-8f55-2bd96db46826 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:03.926623 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-182305fc-dc1a-40d9-b729-6413b0150570 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:03.934108 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-182305fc-dc1a-40d9-b729-6413b0150570 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.325434 May 10 16:48:03.934822 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 254/476] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:03 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:03.937208 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-8c85d9c1-4e2d-4c17-8f55-2bd96db46826 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:03.938838 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-8c85d9c1-4e2d-4c17-8f55-2bd96db46826 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:03.941077 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ed1d61a7-7187-4c28-89d4-865a4ff2766d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:03.941803 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ed1d61a7-7187-4c28-89d4-865a4ff2766d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:03.945137 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-8c85d9c1-4e2d-4c17-8f55-2bd96db46826 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.309328 May 10 16:48:03.945982 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 223/477] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:03 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:03.960470 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ed1d61a7-7187-4c28-89d4-865a4ff2766d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:03.961010 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ed1d61a7-7187-4c28-89d4-865a4ff2766d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:03.961999 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ed1d61a7-7187-4c28-89d4-865a4ff2766d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:03.962938 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ed1d61a7-7187-4c28-89d4-865a4ff2766d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:04.207904 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ed1d61a7-7187-4c28-89d4-865a4ff2766d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:04.216582 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ed1d61a7-7187-4c28-89d4-865a4ff2766d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.279294 May 10 16:48:04.217164 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 255/478] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:03 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:04.951712 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f08695d3-c851-40ca-b2c8-21b8b3c5dea5 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:04.954996 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-f08695d3-c851-40ca-b2c8-21b8b3c5dea5 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:04.966318 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-37fdae6c-234f-451e-bb02-693da1b804f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:04.967967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-37fdae6c-234f-451e-bb02-693da1b804f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:04.968698 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f08695d3-c851-40ca-b2c8-21b8b3c5dea5 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:04.969153 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f08695d3-c851-40ca-b2c8-21b8b3c5dea5 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:04.969943 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f08695d3-c851-40ca-b2c8-21b8b3c5dea5 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:04.970396 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f08695d3-c851-40ca-b2c8-21b8b3c5dea5 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:04.976384 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-37fdae6c-234f-451e-bb02-693da1b804f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:04.977395 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-37fdae6c-234f-451e-bb02-693da1b804f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:04.978618 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-37fdae6c-234f-451e-bb02-693da1b804f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:04.979244 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-37fdae6c-234f-451e-bb02-693da1b804f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:05.243992 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f08695d3-c851-40ca-b2c8-21b8b3c5dea5 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:05.248685 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-37fdae6c-234f-451e-bb02-693da1b804f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:05.255985 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-f08695d3-c851-40ca-b2c8-21b8b3c5dea5 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.308033 May 10 16:48:05.258657 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-37fdae6c-234f-451e-bb02-693da1b804f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:05.261401 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-37fdae6c-234f-451e-bb02-693da1b804f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:05.262753 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-37fdae6c-234f-451e-bb02-693da1b804f6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.302047 May 10 16:48:05.266610 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 224/479] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:04 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:05.273897 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 256/480] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:04 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:05.317068 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b9943a16-c8bc-4453-84d4-5061f5bcaa91 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:05.317811 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-b9943a16-c8bc-4453-84d4-5061f5bcaa91 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:05.324298 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b9943a16-c8bc-4453-84d4-5061f5bcaa91 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:05.324754 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b9943a16-c8bc-4453-84d4-5061f5bcaa91 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:05.325895 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b9943a16-c8bc-4453-84d4-5061f5bcaa91 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:05.327978 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b9943a16-c8bc-4453-84d4-5061f5bcaa91 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:05.504846 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b9943a16-c8bc-4453-84d4-5061f5bcaa91 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:05.518213 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b9943a16-c8bc-4453-84d4-5061f5bcaa91 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.248592 May 10 16:48:05.519215 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 225/481] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:05 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:06.273398 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2d4deba7-5209-44a1-8278-0bee19f38948 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:06.274005 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2d4deba7-5209-44a1-8278-0bee19f38948 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:06.280523 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2d4deba7-5209-44a1-8278-0bee19f38948 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:06.280967 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2d4deba7-5209-44a1-8278-0bee19f38948 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:06.281460 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-8eaebf63-ce19-462e-80eb-ffddd0379f58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:06.281981 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2d4deba7-5209-44a1-8278-0bee19f38948 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:06.282270 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-8eaebf63-ce19-462e-80eb-ffddd0379f58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:06.282373 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2d4deba7-5209-44a1-8278-0bee19f38948 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:06.290359 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8eaebf63-ce19-462e-80eb-ffddd0379f58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:06.290821 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8eaebf63-ce19-462e-80eb-ffddd0379f58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:06.291666 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8eaebf63-ce19-462e-80eb-ffddd0379f58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:06.292146 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8eaebf63-ce19-462e-80eb-ffddd0379f58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:06.489501 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2d4deba7-5209-44a1-8278-0bee19f38948 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:06.494709 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-8eaebf63-ce19-462e-80eb-ffddd0379f58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:06.498449 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2d4deba7-5209-44a1-8278-0bee19f38948 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.228227 May 10 16:48:06.503967 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-8eaebf63-ce19-462e-80eb-ffddd0379f58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:06.505469 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-8eaebf63-ce19-462e-80eb-ffddd0379f58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:06.506617 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-8eaebf63-ce19-462e-80eb-ffddd0379f58 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.229619 May 10 16:48:06.507194 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 226/482] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:06 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:48:06.507531 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 257/483] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:06 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:06.535133 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-9bc8a141-ed51-413f-868b-825ca63efb6d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:06.535843 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-9bc8a141-ed51-413f-868b-825ca63efb6d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:06.542030 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9bc8a141-ed51-413f-868b-825ca63efb6d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:06.542481 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9bc8a141-ed51-413f-868b-825ca63efb6d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:06.543274 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9bc8a141-ed51-413f-868b-825ca63efb6d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:06.543819 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9bc8a141-ed51-413f-868b-825ca63efb6d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:06.686171 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-9bc8a141-ed51-413f-868b-825ca63efb6d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:06.694373 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-9bc8a141-ed51-413f-868b-825ca63efb6d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.162960 May 10 16:48:06.694936 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 227/484] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:06 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:07.514250 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b29f1344-7349-4e2e-b718-1124dc4fe4b7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:07.514923 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b29f1344-7349-4e2e-b718-1124dc4fe4b7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:07.521097 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b29f1344-7349-4e2e-b718-1124dc4fe4b7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:07.521551 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b29f1344-7349-4e2e-b718-1124dc4fe4b7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:07.522334 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b29f1344-7349-4e2e-b718-1124dc4fe4b7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:07.522775 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b29f1344-7349-4e2e-b718-1124dc4fe4b7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:07.525401 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-83d25c45-56ca-4f97-9c4a-1a7b5863b178 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:07.526024 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-83d25c45-56ca-4f97-9c4a-1a7b5863b178 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:07.532664 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-83d25c45-56ca-4f97-9c4a-1a7b5863b178 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:07.533113 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-83d25c45-56ca-4f97-9c4a-1a7b5863b178 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:07.533878 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-83d25c45-56ca-4f97-9c4a-1a7b5863b178 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:07.534314 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-83d25c45-56ca-4f97-9c4a-1a7b5863b178 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:07.723574 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b29f1344-7349-4e2e-b718-1124dc4fe4b7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:07.727440 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-83d25c45-56ca-4f97-9c4a-1a7b5863b178 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:07.730838 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b29f1344-7349-4e2e-b718-1124dc4fe4b7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.220494 May 10 16:48:07.731437 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 258/485] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:07 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:07.736624 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-170eff47-b5e4-494e-b6c7-2a69cac6b4be tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:07.737222 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-83d25c45-56ca-4f97-9c4a-1a7b5863b178 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:07.737358 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-170eff47-b5e4-494e-b6c7-2a69cac6b4be tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:07.739156 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-83d25c45-56ca-4f97-9c4a-1a7b5863b178 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:07.740756 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-83d25c45-56ca-4f97-9c4a-1a7b5863b178 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.218912 May 10 16:48:07.741959 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 228/486] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:07 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:48:07.749517 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-170eff47-b5e4-494e-b6c7-2a69cac6b4be tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:07.749975 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-170eff47-b5e4-494e-b6c7-2a69cac6b4be tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:07.750780 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-170eff47-b5e4-494e-b6c7-2a69cac6b4be tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:07.751263 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-170eff47-b5e4-494e-b6c7-2a69cac6b4be tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:07.879592 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-170eff47-b5e4-494e-b6c7-2a69cac6b4be tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:07.887506 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-170eff47-b5e4-494e-b6c7-2a69cac6b4be tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.154350 May 10 16:48:07.888598 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 259/487] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:07 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:08.748642 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-3b7aa9d7-fa5f-480b-ae6b-0b3470028907 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:08.749251 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-3b7aa9d7-fa5f-480b-ae6b-0b3470028907 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:08.755533 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3b7aa9d7-fa5f-480b-ae6b-0b3470028907 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:08.755979 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3b7aa9d7-fa5f-480b-ae6b-0b3470028907 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:08.756741 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3b7aa9d7-fa5f-480b-ae6b-0b3470028907 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:08.757173 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3b7aa9d7-fa5f-480b-ae6b-0b3470028907 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:08.760023 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-df519eac-fea1-4bc3-8b71-d79ffaacc16a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:08.760632 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-df519eac-fea1-4bc3-8b71-d79ffaacc16a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:08.767148 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-df519eac-fea1-4bc3-8b71-d79ffaacc16a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:08.767601 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-df519eac-fea1-4bc3-8b71-d79ffaacc16a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:08.768382 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-df519eac-fea1-4bc3-8b71-d79ffaacc16a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:08.768806 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-df519eac-fea1-4bc3-8b71-d79ffaacc16a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:08.951480 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-3b7aa9d7-fa5f-480b-ae6b-0b3470028907 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:08.958845 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-3b7aa9d7-fa5f-480b-ae6b-0b3470028907 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.214141 May 10 16:48:08.959456 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 229/488] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:08 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:08.963817 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-0049ca94-129f-409b-b071-95035243a879 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:08.964490 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-0049ca94-129f-409b-b071-95035243a879 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:08.969988 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0049ca94-129f-409b-b071-95035243a879 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:08.970638 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0049ca94-129f-409b-b071-95035243a879 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:08.971426 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0049ca94-129f-409b-b071-95035243a879 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:08.971925 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0049ca94-129f-409b-b071-95035243a879 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:08.973048 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-df519eac-fea1-4bc3-8b71-d79ffaacc16a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:08.981380 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-df519eac-fea1-4bc3-8b71-d79ffaacc16a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:08.982868 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-df519eac-fea1-4bc3-8b71-d79ffaacc16a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:08.984056 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-df519eac-fea1-4bc3-8b71-d79ffaacc16a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.227862 May 10 16:48:08.984613 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 260/489] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:08 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:48:09.100701 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-0049ca94-129f-409b-b071-95035243a879 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:09.108812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-0049ca94-129f-409b-b071-95035243a879 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.148277 May 10 16:48:09.109401 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 230/490] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:08 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:09.975140 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2018e119-36ed-47b3-afb8-12f63778082e tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:09.975692 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2018e119-36ed-47b3-afb8-12f63778082e tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:09.981569 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2018e119-36ed-47b3-afb8-12f63778082e tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:09.982622 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2018e119-36ed-47b3-afb8-12f63778082e tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:09.983420 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2018e119-36ed-47b3-afb8-12f63778082e tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:09.983864 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2018e119-36ed-47b3-afb8-12f63778082e tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:10.005773 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-c03a2cd2-abb8-4cff-b664-c7f431da468f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:10.006415 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-c03a2cd2-abb8-4cff-b664-c7f431da468f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:10.012760 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c03a2cd2-abb8-4cff-b664-c7f431da468f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:10.013708 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c03a2cd2-abb8-4cff-b664-c7f431da468f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:10.014476 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c03a2cd2-abb8-4cff-b664-c7f431da468f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:10.014927 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c03a2cd2-abb8-4cff-b664-c7f431da468f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:10.164957 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2018e119-36ed-47b3-afb8-12f63778082e tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:10.172248 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2018e119-36ed-47b3-afb8-12f63778082e tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.201028 May 10 16:48:10.172825 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 261/491] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:09 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:10.177444 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6ece7fc9-7b32-49dc-8b7f-2c8cc0d619d2 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:10.178055 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6ece7fc9-7b32-49dc-8b7f-2c8cc0d619d2 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:10.183600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6ece7fc9-7b32-49dc-8b7f-2c8cc0d619d2 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:10.184056 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6ece7fc9-7b32-49dc-8b7f-2c8cc0d619d2 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:10.184846 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6ece7fc9-7b32-49dc-8b7f-2c8cc0d619d2 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:10.185279 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6ece7fc9-7b32-49dc-8b7f-2c8cc0d619d2 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:10.190626 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c03a2cd2-abb8-4cff-b664-c7f431da468f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:10.199027 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c03a2cd2-abb8-4cff-b664-c7f431da468f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:10.201069 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c03a2cd2-abb8-4cff-b664-c7f431da468f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:10.202339 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-c03a2cd2-abb8-4cff-b664-c7f431da468f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.200410 May 10 16:48:10.202906 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 231/492] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:10 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:48:10.314620 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6ece7fc9-7b32-49dc-8b7f-2c8cc0d619d2 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:10.322021 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6ece7fc9-7b32-49dc-8b7f-2c8cc0d619d2 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1265 microversion: 2.1 time: 0.148242 May 10 16:48:10.322622 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 262/493] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:10 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:11.188835 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-5877fd52-e32c-47e5-b99a-4a6ef19b222a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:11.189450 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-5877fd52-e32c-47e5-b99a-4a6ef19b222a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:11.195743 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5877fd52-e32c-47e5-b99a-4a6ef19b222a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:11.196193 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5877fd52-e32c-47e5-b99a-4a6ef19b222a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:11.196958 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5877fd52-e32c-47e5-b99a-4a6ef19b222a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:11.197395 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5877fd52-e32c-47e5-b99a-4a6ef19b222a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:11.221073 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a0ee1ca3-1b18-4338-8476-d5c447b1bd08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:11.221705 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a0ee1ca3-1b18-4338-8476-d5c447b1bd08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:11.227816 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a0ee1ca3-1b18-4338-8476-d5c447b1bd08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:11.228369 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a0ee1ca3-1b18-4338-8476-d5c447b1bd08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:11.229194 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a0ee1ca3-1b18-4338-8476-d5c447b1bd08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:11.229631 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a0ee1ca3-1b18-4338-8476-d5c447b1bd08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:11.456602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-5877fd52-e32c-47e5-b99a-4a6ef19b222a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:11.462430 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a0ee1ca3-1b18-4338-8476-d5c447b1bd08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:11.464604 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-5877fd52-e32c-47e5-b99a-4a6ef19b222a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1260 microversion: 2.1 time: 0.279611 May 10 16:48:11.465184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 232/494] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:11 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:11.472453 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a0ee1ca3-1b18-4338-8476-d5c447b1bd08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:11.474046 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a0ee1ca3-1b18-4338-8476-d5c447b1bd08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:11.475305 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a0ee1ca3-1b18-4338-8476-d5c447b1bd08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.258161 May 10 16:48:11.480526 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-da18a9ad-78a6-495b-a760-5055de879869 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:11.481215 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-da18a9ad-78a6-495b-a760-5055de879869 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:11.487475 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 263/495] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:11 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:48:11.488069 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-da18a9ad-78a6-495b-a760-5055de879869 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:11.488707 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-da18a9ad-78a6-495b-a760-5055de879869 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:11.489488 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-da18a9ad-78a6-495b-a760-5055de879869 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:11.490201 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-da18a9ad-78a6-495b-a760-5055de879869 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:11.621943 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-da18a9ad-78a6-495b-a760-5055de879869 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:11.629486 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-da18a9ad-78a6-495b-a760-5055de879869 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1451 microversion: 2.1 time: 0.153872 May 10 16:48:11.630271 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 233/496] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:11 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:11.647224 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ade7bb26-fa1c-45b9-b2b0-ee3db45bd6d8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:11.647838 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ade7bb26-fa1c-45b9-b2b0-ee3db45bd6d8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:11.663049 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ade7bb26-fa1c-45b9-b2b0-ee3db45bd6d8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:11.663503 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ade7bb26-fa1c-45b9-b2b0-ee3db45bd6d8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:11.664335 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ade7bb26-fa1c-45b9-b2b0-ee3db45bd6d8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:11.664717 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ade7bb26-fa1c-45b9-b2b0-ee3db45bd6d8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:11.797261 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ade7bb26-fa1c-45b9-b2b0-ee3db45bd6d8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:11.804835 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ade7bb26-fa1c-45b9-b2b0-ee3db45bd6d8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1451 microversion: 2.1 time: 0.161587 May 10 16:48:11.805406 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 264/497] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:11 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:11.926507 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-4634978e-2ef8-42b4-a919-28cd5764ed18 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c7d75da-696e-4ffe-b55d-52defcffb95d", "device": "/dev/sdb"}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:11.926507 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-4634978e-2ef8-42b4-a919-28cd5764ed18 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:11.934437 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4634978e-2ef8-42b4-a919-28cd5764ed18 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:11.935465 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4634978e-2ef8-42b4-a919-28cd5764ed18 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:11.936264 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4634978e-2ef8-42b4-a919-28cd5764ed18 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:11.939853 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4634978e-2ef8-42b4-a919-28cd5764ed18 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:12.249551 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-4634978e-2ef8-42b4-a919-28cd5764ed18 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "POST /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335306 May 10 16:48:12.264798 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 234/498] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 16:48:11 2022] POST /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:48:12.482504 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a7f87424-f488-44c1-b67b-e844eff862b3 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:12.483147 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a7f87424-f488-44c1-b67b-e844eff862b3 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:12.488944 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a7f87424-f488-44c1-b67b-e844eff862b3 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:12.489588 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a7f87424-f488-44c1-b67b-e844eff862b3 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:12.490374 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a7f87424-f488-44c1-b67b-e844eff862b3 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:12.491025 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a7f87424-f488-44c1-b67b-e844eff862b3 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:12.495674 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-ab6d22d9-19ed-4504-8a1d-90104d7f2ff8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:12.496522 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-ab6d22d9-19ed-4504-8a1d-90104d7f2ff8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:12.504315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ab6d22d9-19ed-4504-8a1d-90104d7f2ff8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:12.505088 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ab6d22d9-19ed-4504-8a1d-90104d7f2ff8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:12.506367 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ab6d22d9-19ed-4504-8a1d-90104d7f2ff8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:12.507037 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ab6d22d9-19ed-4504-8a1d-90104d7f2ff8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:12.710981 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a7f87424-f488-44c1-b67b-e844eff862b3 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:12.718873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a7f87424-f488-44c1-b67b-e844eff862b3 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1444 microversion: 2.1 time: 0.240785 May 10 16:48:12.719790 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 265/499] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:12 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1444 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:12.727005 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ab6d22d9-19ed-4504-8a1d-90104d7f2ff8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:12.735616 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ab6d22d9-19ed-4504-8a1d-90104d7f2ff8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:12.737142 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ab6d22d9-19ed-4504-8a1d-90104d7f2ff8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:12.737320 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9ee97a46-ff51-4bbe-8f36-1baee78f95d0 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:12.737797 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9ee97a46-ff51-4bbe-8f36-1baee78f95d0 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:12.738313 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-ab6d22d9-19ed-4504-8a1d-90104d7f2ff8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.247935 May 10 16:48:12.739411 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 235/500] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:12 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:48:12.743710 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9ee97a46-ff51-4bbe-8f36-1baee78f95d0 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:12.744162 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9ee97a46-ff51-4bbe-8f36-1baee78f95d0 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:12.745101 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9ee97a46-ff51-4bbe-8f36-1baee78f95d0 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:12.745669 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9ee97a46-ff51-4bbe-8f36-1baee78f95d0 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:12.881291 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9ee97a46-ff51-4bbe-8f36-1baee78f95d0 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:12.889295 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9ee97a46-ff51-4bbe-8f36-1baee78f95d0 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1444 microversion: 2.1 time: 0.156880 May 10 16:48:12.889969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 266/501] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:12 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:13.757619 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-e661de52-8c25-481f-b3f6-cbb54b6f8cb8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:13.758473 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-e661de52-8c25-481f-b3f6-cbb54b6f8cb8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:13.765276 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e661de52-8c25-481f-b3f6-cbb54b6f8cb8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:13.765852 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e661de52-8c25-481f-b3f6-cbb54b6f8cb8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:13.766697 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e661de52-8c25-481f-b3f6-cbb54b6f8cb8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:13.767241 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e661de52-8c25-481f-b3f6-cbb54b6f8cb8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:14.161476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-97055613-de92-4fdb-916d-c062e3f31b89 req-b771bd0f-81b4-48db-9eb4-49132fe27e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "256c0577-62c0-4b3f-bc59-3171e7928b0c", "tag": "7f137a16-3c79-4550-b56b-4ded57073eee"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:14.172044 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-97055613-de92-4fdb-916d-c062e3f31b89 req-b771bd0f-81b4-48db-9eb4-49132fe27e37 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:14.172694 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-97055613-de92-4fdb-916d-c062e3f31b89 req-b771bd0f-81b4-48db-9eb4-49132fe27e37 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:14.198846 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-e661de52-8c25-481f-b3f6-cbb54b6f8cb8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:14.210176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-e661de52-8c25-481f-b3f6-cbb54b6f8cb8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:14.212377 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-e661de52-8c25-481f-b3f6-cbb54b6f8cb8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:14.213071 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-97055613-de92-4fdb-916d-c062e3f31b89 req-b771bd0f-81b4-48db-9eb4-49132fe27e37 service nova] Creating event network-changed:7f137a16-3c79-4550-b56b-4ded57073eee for instance 256c0577-62c0-4b3f-bc59-3171e7928b0c on hv-cinder-84130 May 10 16:48:14.214149 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-e661de52-8c25-481f-b3f6-cbb54b6f8cb8 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.460564 May 10 16:48:14.215625 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 236/502] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:13 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:14.219260 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-97055613-de92-4fdb-916d-c062e3f31b89 req-b771bd0f-81b4-48db-9eb4-49132fe27e37 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061409 May 10 16:48:14.220441 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 267/503] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:48:14.999476 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-a33aec7e-41ae-4fc8-ab47-349b3fa36b04 req-1d9dfe11-88f1-4612-a6f0-cb93b933e239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b14b06-9428-41e6-ae67-68b253218e24", "tag": "fdeeb8a2-0f74-40ea-acb1-f138b641a2ce"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:15.010374 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-a33aec7e-41ae-4fc8-ab47-349b3fa36b04 req-1d9dfe11-88f1-4612-a6f0-cb93b933e239 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:15.010814 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-a33aec7e-41ae-4fc8-ab47-349b3fa36b04 req-1d9dfe11-88f1-4612-a6f0-cb93b933e239 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:15.023023 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-a33aec7e-41ae-4fc8-ab47-349b3fa36b04 req-1d9dfe11-88f1-4612-a6f0-cb93b933e239 service nova] Creating event network-changed:fdeeb8a2-0f74-40ea-acb1-f138b641a2ce for instance 25b14b06-9428-41e6-ae67-68b253218e24 on hv-cinder-84130 May 10 16:48:15.028029 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-a33aec7e-41ae-4fc8-ab47-349b3fa36b04 req-1d9dfe11-88f1-4612-a6f0-cb93b933e239 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032663 May 10 16:48:15.028655 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 237/504] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:48:15.233769 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-18ecd5ef-d646-4fae-9720-a90f74497399 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:15.234594 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-18ecd5ef-d646-4fae-9720-a90f74497399 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:15.240923 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-18ecd5ef-d646-4fae-9720-a90f74497399 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:15.241440 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-18ecd5ef-d646-4fae-9720-a90f74497399 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:15.242455 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-18ecd5ef-d646-4fae-9720-a90f74497399 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:15.243181 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-18ecd5ef-d646-4fae-9720-a90f74497399 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:15.386853 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-18ecd5ef-d646-4fae-9720-a90f74497399 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:15.396049 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-18ecd5ef-d646-4fae-9720-a90f74497399 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:15.397549 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-18ecd5ef-d646-4fae-9720-a90f74497399 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:15.398707 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-18ecd5ef-d646-4fae-9720-a90f74497399 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.169813 May 10 16:48:15.399318 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 268/505] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:15 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:16.417695 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b8ea1013-33c6-4139-b253-078cf68d6830 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:16.418393 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-b8ea1013-33c6-4139-b253-078cf68d6830 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:16.425592 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b8ea1013-33c6-4139-b253-078cf68d6830 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:16.426305 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b8ea1013-33c6-4139-b253-078cf68d6830 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:16.427104 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b8ea1013-33c6-4139-b253-078cf68d6830 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:16.427543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b8ea1013-33c6-4139-b253-078cf68d6830 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:16.560253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b8ea1013-33c6-4139-b253-078cf68d6830 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:16.568423 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b8ea1013-33c6-4139-b253-078cf68d6830 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:16.569931 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b8ea1013-33c6-4139-b253-078cf68d6830 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:16.571159 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b8ea1013-33c6-4139-b253-078cf68d6830 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.157654 May 10 16:48:16.571721 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 238/506] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:16 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:17.588980 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-dd7a60f7-b21e-44d6-ad3b-e2439e965dc6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:17.589624 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-dd7a60f7-b21e-44d6-ad3b-e2439e965dc6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:17.596175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dd7a60f7-b21e-44d6-ad3b-e2439e965dc6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:17.596625 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dd7a60f7-b21e-44d6-ad3b-e2439e965dc6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:17.597732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dd7a60f7-b21e-44d6-ad3b-e2439e965dc6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:17.598565 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dd7a60f7-b21e-44d6-ad3b-e2439e965dc6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:17.813125 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-dd7a60f7-b21e-44d6-ad3b-e2439e965dc6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:17.821327 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-dd7a60f7-b21e-44d6-ad3b-e2439e965dc6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:17.822831 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-dd7a60f7-b21e-44d6-ad3b-e2439e965dc6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:17.824024 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-dd7a60f7-b21e-44d6-ad3b-e2439e965dc6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.238982 May 10 16:48:17.824585 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 269/507] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:17 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:18.842011 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-965f7a12-86db-499a-a667-0cd410f11b03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:18.842618 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-965f7a12-86db-499a-a667-0cd410f11b03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:18.861115 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-965f7a12-86db-499a-a667-0cd410f11b03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:18.861771 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-965f7a12-86db-499a-a667-0cd410f11b03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:18.863218 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-965f7a12-86db-499a-a667-0cd410f11b03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:18.863665 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-965f7a12-86db-499a-a667-0cd410f11b03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:19.010232 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-965f7a12-86db-499a-a667-0cd410f11b03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:19.019527 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-965f7a12-86db-499a-a667-0cd410f11b03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:19.021045 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-965f7a12-86db-499a-a667-0cd410f11b03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:19.022275 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-965f7a12-86db-499a-a667-0cd410f11b03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.184592 May 10 16:48:19.022828 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 239/508] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:18 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:20.041722 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d289b459-d5e8-4f51-8784-166a2a6768b6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:20.043649 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d289b459-d5e8-4f51-8784-166a2a6768b6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:20.050210 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d289b459-d5e8-4f51-8784-166a2a6768b6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:20.050574 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d289b459-d5e8-4f51-8784-166a2a6768b6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:20.051810 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d289b459-d5e8-4f51-8784-166a2a6768b6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:20.052417 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d289b459-d5e8-4f51-8784-166a2a6768b6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:20.187460 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d289b459-d5e8-4f51-8784-166a2a6768b6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:20.195687 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d289b459-d5e8-4f51-8784-166a2a6768b6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:20.197147 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d289b459-d5e8-4f51-8784-166a2a6768b6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:20.198298 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d289b459-d5e8-4f51-8784-166a2a6768b6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.160836 May 10 16:48:20.198852 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 270/509] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:20 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:20.795770 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-cd8bc831-a760-48de-826e-654e67775c6b req-8c383ca4-21d0-4bff-bb8a-398faa96f255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a49eb5-dff1-452f-9e73-a8a9b0c64649", "name": "network-vif-plugged", "status": "completed", "tag": "0e22ce60-edf0-4181-80b7-08f1d62c396b"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:20.805269 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-cd8bc831-a760-48de-826e-654e67775c6b req-8c383ca4-21d0-4bff-bb8a-398faa96f255 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:20.805731 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-cd8bc831-a760-48de-826e-654e67775c6b req-8c383ca4-21d0-4bff-bb8a-398faa96f255 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:20.817842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-cd8bc831-a760-48de-826e-654e67775c6b req-8c383ca4-21d0-4bff-bb8a-398faa96f255 service nova] Creating event network-vif-plugged:0e22ce60-edf0-4181-80b7-08f1d62c396b for instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 on hv-cinder-84130 May 10 16:48:20.823220 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-cd8bc831-a760-48de-826e-654e67775c6b req-8c383ca4-21d0-4bff-bb8a-398faa96f255 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030911 May 10 16:48:20.824342 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 240/510] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:48:21.216270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-114db48d-e6a3-4daf-9581-6d59c53a7341 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:21.216705 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-114db48d-e6a3-4daf-9581-6d59c53a7341 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:21.222548 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-114db48d-e6a3-4daf-9581-6d59c53a7341 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:21.223041 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-114db48d-e6a3-4daf-9581-6d59c53a7341 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:21.223814 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-114db48d-e6a3-4daf-9581-6d59c53a7341 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:21.224251 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-114db48d-e6a3-4daf-9581-6d59c53a7341 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:21.363025 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-114db48d-e6a3-4daf-9581-6d59c53a7341 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:21.371645 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-114db48d-e6a3-4daf-9581-6d59c53a7341 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:21.374025 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-114db48d-e6a3-4daf-9581-6d59c53a7341 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:21.375402 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-114db48d-e6a3-4daf-9581-6d59c53a7341 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.163177 May 10 16:48:21.376115 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 271/511] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:21 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:48:22.394106 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-d46e20c6-a053-4287-a706-7f3adff044ec tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:22.394799 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-d46e20c6-a053-4287-a706-7f3adff044ec tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:22.401300 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d46e20c6-a053-4287-a706-7f3adff044ec tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:22.401749 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d46e20c6-a053-4287-a706-7f3adff044ec tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:22.402514 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d46e20c6-a053-4287-a706-7f3adff044ec tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:22.402953 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d46e20c6-a053-4287-a706-7f3adff044ec tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:22.535421 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-d46e20c6-a053-4287-a706-7f3adff044ec tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:22.544718 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-d46e20c6-a053-4287-a706-7f3adff044ec tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:22.546230 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-d46e20c6-a053-4287-a706-7f3adff044ec tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:22.547417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-d46e20c6-a053-4287-a706-7f3adff044ec tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.157557 May 10 16:48:22.547970 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 241/512] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:22 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:23.566808 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-712b586e-9152-4414-b1bf-5336dad2d666 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:23.567445 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-712b586e-9152-4414-b1bf-5336dad2d666 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:23.573775 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-712b586e-9152-4414-b1bf-5336dad2d666 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:23.574229 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-712b586e-9152-4414-b1bf-5336dad2d666 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:23.575048 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-712b586e-9152-4414-b1bf-5336dad2d666 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:23.575500 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-712b586e-9152-4414-b1bf-5336dad2d666 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:23.719102 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-712b586e-9152-4414-b1bf-5336dad2d666 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:23.727352 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-712b586e-9152-4414-b1bf-5336dad2d666 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:23.728904 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-712b586e-9152-4414-b1bf-5336dad2d666 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:23.730063 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-712b586e-9152-4414-b1bf-5336dad2d666 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1809 microversion: 2.20 time: 0.167760 May 10 16:48:23.730620 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 272/513] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:23 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:24.748462 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b9bebced-ca60-4c63-a2db-08c36412abb9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:24.749600 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-b9bebced-ca60-4c63-a2db-08c36412abb9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:24.756294 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b9bebced-ca60-4c63-a2db-08c36412abb9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:24.756748 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b9bebced-ca60-4c63-a2db-08c36412abb9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:24.757539 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b9bebced-ca60-4c63-a2db-08c36412abb9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:24.758005 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b9bebced-ca60-4c63-a2db-08c36412abb9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:24.889215 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b9bebced-ca60-4c63-a2db-08c36412abb9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:24.897417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b9bebced-ca60-4c63-a2db-08c36412abb9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:24.898900 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b9bebced-ca60-4c63-a2db-08c36412abb9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:24.900068 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b9bebced-ca60-4c63-a2db-08c36412abb9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1796 microversion: 2.20 time: 0.156168 May 10 16:48:24.900623 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 242/514] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:48:24 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1796 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:48:43.244553 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f64d59fb-b7fb-415f-a2bb-53409601c9a3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:43.245116 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f64d59fb-b7fb-415f-a2bb-53409601c9a3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:43.252081 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f64d59fb-b7fb-415f-a2bb-53409601c9a3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:43.252813 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f64d59fb-b7fb-415f-a2bb-53409601c9a3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:43.253612 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f64d59fb-b7fb-415f-a2bb-53409601c9a3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:43.254021 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f64d59fb-b7fb-415f-a2bb-53409601c9a3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:43.381068 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-f64d59fb-b7fb-415f-a2bb-53409601c9a3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lazy-loading 'services' on Instance uuid 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:48:43.494690 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f64d59fb-b7fb-415f-a2bb-53409601c9a3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8/os-volume_attachments/8c7d75da-696e-4ffe-b55d-52defcffb95d" status: 202 len: 0 microversion: 2.1 time: 0.254341 May 10 16:48:43.495631 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 273/515] 10.222.0.57 () {58 vars in 1415 bytes} [Tue May 10 16:48:43 2022] DELETE /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8/os-volume_attachments/8c7d75da-696e-4ffe-b55d-52defcffb95d => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:48:45.668595 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-9c5ce233-cab4-4b38-b6d7-c793106c2d46 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:45.669117 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-9c5ce233-cab4-4b38-b6d7-c793106c2d46 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:45.675704 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9c5ce233-cab4-4b38-b6d7-c793106c2d46 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:45.676417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9c5ce233-cab4-4b38-b6d7-c793106c2d46 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:45.677191 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9c5ce233-cab4-4b38-b6d7-c793106c2d46 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:45.677625 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9c5ce233-cab4-4b38-b6d7-c793106c2d46 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:45.705062 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-9c5ce233-cab4-4b38-b6d7-c793106c2d46 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Going to try to terminate instance {{(pid=128925) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:48:45.777877 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-9c5ce233-cab4-4b38-b6d7-c793106c2d46 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 204 len: 0 microversion: 2.1 time: 0.112309 May 10 16:48:45.779274 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 243/516] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 16:48:45 2022] DELETE /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:48:45.792775 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d1235a23-e605-46a5-97b4-a262046afe10 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:45.793711 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d1235a23-e605-46a5-97b4-a262046afe10 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:45.800282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d1235a23-e605-46a5-97b4-a262046afe10 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:45.800731 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d1235a23-e605-46a5-97b4-a262046afe10 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:45.801768 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d1235a23-e605-46a5-97b4-a262046afe10 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:45.802209 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d1235a23-e605-46a5-97b4-a262046afe10 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:45.927740 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d1235a23-e605-46a5-97b4-a262046afe10 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:45.935034 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d1235a23-e605-46a5-97b4-a262046afe10 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1513 microversion: 2.1 time: 0.149188 May 10 16:48:45.936089 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 274/517] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:45 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:46.953206 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-21a200b4-f3aa-4fab-ab73-64d7e4b8017f tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:46.953861 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-21a200b4-f3aa-4fab-ab73-64d7e4b8017f tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:46.962737 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-21a200b4-f3aa-4fab-ab73-64d7e4b8017f tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:46.963806 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-21a200b4-f3aa-4fab-ab73-64d7e4b8017f tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:46.965183 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-21a200b4-f3aa-4fab-ab73-64d7e4b8017f tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:46.965985 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-21a200b4-f3aa-4fab-ab73-64d7e4b8017f tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:47.096793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-21a200b4-f3aa-4fab-ab73-64d7e4b8017f tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:47.104052 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-21a200b4-f3aa-4fab-ab73-64d7e4b8017f tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1513 microversion: 2.1 time: 0.155184 May 10 16:48:47.104616 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 244/518] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:46 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:48.121394 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-001786cd-ec81-40ed-8022-063c0374d752 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:48.122005 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-001786cd-ec81-40ed-8022-063c0374d752 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:48.128403 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-001786cd-ec81-40ed-8022-063c0374d752 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:48.128847 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-001786cd-ec81-40ed-8022-063c0374d752 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:48.129605 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-001786cd-ec81-40ed-8022-063c0374d752 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:48.130032 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-001786cd-ec81-40ed-8022-063c0374d752 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:48.263542 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-001786cd-ec81-40ed-8022-063c0374d752 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:48.270705 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-001786cd-ec81-40ed-8022-063c0374d752 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1513 microversion: 2.1 time: 0.153141 May 10 16:48:48.271311 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 275/519] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:48 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:48.785683 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-bfd8f4cd-39db-4565-9248-96f6ef1ae672 req-97ae4045-0c16-4bdb-87bc-9359f3423483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8", "name": "network-vif-deleted", "tag": "0dfc5b6b-8673-496e-baeb-ebd76ccf5549"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:48.803737 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-bfd8f4cd-39db-4565-9248-96f6ef1ae672 req-97ae4045-0c16-4bdb-87bc-9359f3423483 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:48.804187 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-bfd8f4cd-39db-4565-9248-96f6ef1ae672 req-97ae4045-0c16-4bdb-87bc-9359f3423483 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:48.814816 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-bfd8f4cd-39db-4565-9248-96f6ef1ae672 req-97ae4045-0c16-4bdb-87bc-9359f3423483 service nova] Creating event network-vif-deleted:0dfc5b6b-8673-496e-baeb-ebd76ccf5549 for instance 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 on hv-cinder-84130 May 10 16:48:48.819743 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-bfd8f4cd-39db-4565-9248-96f6ef1ae672 req-97ae4045-0c16-4bdb-87bc-9359f3423483 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037953 May 10 16:48:48.820356 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 245/520] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:48:49.288626 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4bd3bb2e-0dd2-40c4-b9e3-0470aea74878 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:49.291130 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4bd3bb2e-0dd2-40c4-b9e3-0470aea74878 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:49.298748 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4bd3bb2e-0dd2-40c4-b9e3-0470aea74878 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:49.299234 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4bd3bb2e-0dd2-40c4-b9e3-0470aea74878 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:49.300442 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4bd3bb2e-0dd2-40c4-b9e3-0470aea74878 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:49.300971 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4bd3bb2e-0dd2-40c4-b9e3-0470aea74878 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:49.335013 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4bd3bb2e-0dd2-40c4-b9e3-0470aea74878 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:49.335494 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4bd3bb2e-0dd2-40c4-b9e3-0470aea74878 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:49.336132 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-4bd3bb2e-0dd2-40c4-b9e3-0470aea74878 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lazy-loading 'fault' on Instance uuid 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:48:49.377888 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4bd3bb2e-0dd2-40c4-b9e3-0470aea74878 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:49.385335 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4bd3bb2e-0dd2-40c4-b9e3-0470aea74878 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 200 len: 1308 microversion: 2.1 time: 0.101403 May 10 16:48:49.386096 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 276/521] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:49 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:48:50.404479 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-834c7605-9eaa-4ff0-9b91-4b5908ff9231 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:50.405165 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-834c7605-9eaa-4ff0-9b91-4b5908ff9231 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:50.411596 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-834c7605-9eaa-4ff0-9b91-4b5908ff9231 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:50.412042 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-834c7605-9eaa-4ff0-9b91-4b5908ff9231 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:50.412805 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-834c7605-9eaa-4ff0-9b91-4b5908ff9231 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:50.413233 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-834c7605-9eaa-4ff0-9b91-4b5908ff9231 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:50.428142 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.wsgi [None req-834c7605-9eaa-4ff0-9b91-4b5908ff9231 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] HTTP exception thrown: Instance 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 could not be found. May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-834c7605-9eaa-4ff0-9b91-4b5908ff9231 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Request method failure captured: May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 HTTP/1.1 May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 0 May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepcL7Y-MwgdxOwwjoLDONtgPUnp7vYHjUjIgzdh34DM0PJCInlezbxdiXXsbKmL3KiAylggGWzhxmRBoqjYy0E_6BXF5F1xp_ixv7tDAhZViHJNXw8YD6kRPr0E0OLm27a7oKdCGhrs79y9XbbpWpn5h5IiJsn-FndutQoJBpzIlD28 May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: aae4278fddbd44cbb508e4fa63f9f7a4 May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-VolumesSnapshotTestJSON-668485509 May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:48:50.430145 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:48:50.431700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aae4278fddbd44cbb508e4fa63f9f7a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aae4278fddbd44cbb508e4fa63f9f7a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aae4278fddbd44cbb508e4fa63f9f7a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aae4278fddbd44cbb508e4fa63f9f7a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:48:50.431700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-VolumesSnapshotTestJSON-668485509 May 10 16:48:50.431700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: aae4278fddbd44cbb508e4fa63f9f7a4 May 10 16:48:50.431700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-668485509 May 10 16:48:50.431700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-VolumesSnapshotTestJSON-668485509-project May 10 16:48:50.431700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:48:50.431700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:48:50.431700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: 80f1e7854604414e8174b87e039ef401 May 10 16:48:50.431700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-VolumesSnapshotTestJSON-668485509-project May 10 16:48:50.431700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: > May 10 16:48:50.431700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Instance 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 could not be found. May 10 16:48:50.431700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'id': '2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8'} May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 could not be found. May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:48:50.432563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:48:50.433840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:48:50.433840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:48:50.433840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:48:50.433840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:48:50.433840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:48:50.433840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:48:50.433840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:48:50.433840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 could not be found. May 10 16:48:50.433840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:48:50.433840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:48:50.433840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:48:50.433840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:48:50.433840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:48:50.433840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:48:50.433840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:48:50.433840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:48:50.433840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 could not be found. May 10 16:48:50.433840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:48:50.435012 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-834c7605-9eaa-4ff0-9b91-4b5908ff9231 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Returning 404 to user: Instance 2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 could not be found. {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:48:50.435012 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-834c7605-9eaa-4ff0-9b91-4b5908ff9231 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8" status: 404 len: 111 microversion: 2.1 time: 0.032261 May 10 16:48:50.435012 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 246/522] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:50 2022] GET /compute/v2.1/servers/2d5651b0-67f2-4c9b-97ed-19a9a39bdaf8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:48:58.201127 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e80840ea-b616-4a85-8f65-885910f1a9b3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1424921200", "imageRef": "3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b", "flavorRef": "452", "networks": [{"uuid": "6d3c4858-4172-4c48-9213-0754e535775f"}]}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:48:58.254037 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-e80840ea-b616-4a85-8f65-885910f1a9b3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] validate_networks() for [('6d3c4858-4172-4c48-9213-0754e535775f', None, None, None, None, None)] {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:48:58.583428 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-e80840ea-b616-4a85-8f65-885910f1a9b3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:48:58.583847 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-e80840ea-b616-4a85-8f65-885910f1a9b3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:48:58.584317 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-e80840ea-b616-4a85-8f65-885910f1a9b3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:48:58.584719 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-e80840ea-b616-4a85-8f65-885910f1a9b3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:48:58.585153 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-e80840ea-b616-4a85-8f65-885910f1a9b3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:48:58.594427 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e80840ea-b616-4a85-8f65-885910f1a9b3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:58.595098 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e80840ea-b616-4a85-8f65-885910f1a9b3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:58.595905 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e80840ea-b616-4a85-8f65-885910f1a9b3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:58.596334 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e80840ea-b616-4a85-8f65-885910f1a9b3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:58.613463 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-e80840ea-b616-4a85-8f65-885910f1a9b3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Getting quotas for project aae4278fddbd44cbb508e4fa63f9f7a4. Resources: {'instances', 'cores', 'ram'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:48:58.617280 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-e80840ea-b616-4a85-8f65-885910f1a9b3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Getting quotas for user 80f1e7854604414e8174b87e039ef401 and project aae4278fddbd44cbb508e4fa63f9f7a4. Resources: {'instances', 'cores', 'ram'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:48:58.628290 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e80840ea-b616-4a85-8f65-885910f1a9b3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:48:58.630507 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e80840ea-b616-4a85-8f65-885910f1a9b3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:48:58.675280 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e80840ea-b616-4a85-8f65-885910f1a9b3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.478461 May 10 16:48:58.675906 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 277/523] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 16:48:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:48:58.687277 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-c855338e-0ec0-4c53-9e9d-44e9e7dcf649 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:58.695652 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-c855338e-0ec0-4c53-9e9d-44e9e7dcf649 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:58.754685 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c855338e-0ec0-4c53-9e9d-44e9e7dcf649 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:58.761590 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-c855338e-0ec0-4c53-9e9d-44e9e7dcf649 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3" status: 200 len: 1219 microversion: 2.1 time: 0.079488 May 10 16:48:58.762154 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 247/524] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:58 2022] GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:48:59.779778 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-cc3babb1-0c19-43e7-a897-f82c43495b2c tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:48:59.780396 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-cc3babb1-0c19-43e7-a897-f82c43495b2c tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:48:59.788393 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cc3babb1-0c19-43e7-a897-f82c43495b2c tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:59.789067 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cc3babb1-0c19-43e7-a897-f82c43495b2c tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:59.789859 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cc3babb1-0c19-43e7-a897-f82c43495b2c tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:48:59.790300 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cc3babb1-0c19-43e7-a897-f82c43495b2c tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:48:59.860125 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-cc3babb1-0c19-43e7-a897-f82c43495b2c tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:48:59.867498 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-cc3babb1-0c19-43e7-a897-f82c43495b2c tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3" status: 200 len: 1279 microversion: 2.1 time: 0.091746 May 10 16:48:59.868523 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 278/525] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:48:59 2022] GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3 => generated 1279 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:00.890577 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-a3e75ed7-6c26-437d-935a-d39e0727daa3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:00.891342 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-a3e75ed7-6c26-437d-935a-d39e0727daa3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:00.908002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a3e75ed7-6c26-437d-935a-d39e0727daa3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:00.908449 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a3e75ed7-6c26-437d-935a-d39e0727daa3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:00.909233 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a3e75ed7-6c26-437d-935a-d39e0727daa3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:00.909672 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a3e75ed7-6c26-437d-935a-d39e0727daa3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:01.300858 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-a3e75ed7-6c26-437d-935a-d39e0727daa3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:01.308670 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-a3e75ed7-6c26-437d-935a-d39e0727daa3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3" status: 200 len: 1319 microversion: 2.1 time: 0.423133 May 10 16:49:01.309361 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 248/526] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:00 2022] GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3 => generated 1319 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:01.382865 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-36f1fd36-21a1-4c05-b53c-eb2f75d6ce76 req-b57847fe-bf3d-43ca-b309-495ed62e775a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61ed50de-d8d7-43be-83ab-234b8c5783b3", "tag": "0c69eead-8ed3-4a29-b116-0b5d0dbf676c"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:01.391514 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-36f1fd36-21a1-4c05-b53c-eb2f75d6ce76 req-b57847fe-bf3d-43ca-b309-495ed62e775a service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:01.391956 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-36f1fd36-21a1-4c05-b53c-eb2f75d6ce76 req-b57847fe-bf3d-43ca-b309-495ed62e775a service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:01.405580 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-36f1fd36-21a1-4c05-b53c-eb2f75d6ce76 req-b57847fe-bf3d-43ca-b309-495ed62e775a service nova] Creating event network-changed:0c69eead-8ed3-4a29-b116-0b5d0dbf676c for instance 61ed50de-d8d7-43be-83ab-234b8c5783b3 on hv-cinder-84130 May 10 16:49:01.410840 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-36f1fd36-21a1-4c05-b53c-eb2f75d6ce76 req-b57847fe-bf3d-43ca-b309-495ed62e775a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032791 May 10 16:49:01.411460 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 279/527] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:02.326365 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-7459d44e-b3f4-4b95-a3d9-253c6a93ed92 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:02.327009 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-7459d44e-b3f4-4b95-a3d9-253c6a93ed92 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:02.334023 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7459d44e-b3f4-4b95-a3d9-253c6a93ed92 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:02.334514 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7459d44e-b3f4-4b95-a3d9-253c6a93ed92 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:02.335426 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7459d44e-b3f4-4b95-a3d9-253c6a93ed92 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:02.335867 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7459d44e-b3f4-4b95-a3d9-253c6a93ed92 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:02.463988 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7459d44e-b3f4-4b95-a3d9-253c6a93ed92 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:02.471267 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-7459d44e-b3f4-4b95-a3d9-253c6a93ed92 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3" status: 200 len: 1319 microversion: 2.1 time: 0.148762 May 10 16:49:02.471826 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 249/528] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:02 2022] GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:03.488046 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8d655845-94b0-4d73-b48e-6613030eb173 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:03.488737 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8d655845-94b0-4d73-b48e-6613030eb173 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:03.494893 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8d655845-94b0-4d73-b48e-6613030eb173 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:03.495366 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8d655845-94b0-4d73-b48e-6613030eb173 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:03.496133 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8d655845-94b0-4d73-b48e-6613030eb173 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:03.496590 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8d655845-94b0-4d73-b48e-6613030eb173 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:03.624175 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8d655845-94b0-4d73-b48e-6613030eb173 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:03.631173 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8d655845-94b0-4d73-b48e-6613030eb173 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3" status: 200 len: 1319 microversion: 2.1 time: 0.147240 May 10 16:49:03.631728 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 280/529] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:03 2022] GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:04.648339 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-abdb7f30-a4e8-4c44-87d4-1724f64dde40 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:04.648947 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-abdb7f30-a4e8-4c44-87d4-1724f64dde40 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:04.655751 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-abdb7f30-a4e8-4c44-87d4-1724f64dde40 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:04.656194 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-abdb7f30-a4e8-4c44-87d4-1724f64dde40 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:04.656946 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-abdb7f30-a4e8-4c44-87d4-1724f64dde40 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:04.657377 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-abdb7f30-a4e8-4c44-87d4-1724f64dde40 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:04.781660 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-abdb7f30-a4e8-4c44-87d4-1724f64dde40 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:04.788805 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-abdb7f30-a4e8-4c44-87d4-1724f64dde40 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3" status: 200 len: 1319 microversion: 2.1 time: 0.144310 May 10 16:49:04.789368 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 250/530] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:04 2022] GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:05.805749 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6caebad7-4180-4c89-a3d4-d4e631c370ec tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:05.806324 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6caebad7-4180-4c89-a3d4-d4e631c370ec tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:05.812822 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6caebad7-4180-4c89-a3d4-d4e631c370ec tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:05.813272 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6caebad7-4180-4c89-a3d4-d4e631c370ec tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:05.814044 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6caebad7-4180-4c89-a3d4-d4e631c370ec tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:05.814483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6caebad7-4180-4c89-a3d4-d4e631c370ec tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:05.942296 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6caebad7-4180-4c89-a3d4-d4e631c370ec tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:05.949472 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6caebad7-4180-4c89-a3d4-d4e631c370ec tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3" status: 200 len: 1319 microversion: 2.1 time: 0.147619 May 10 16:49:05.950034 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 281/531] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:05 2022] GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:06.966203 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-a9d0c45d-fc8c-4b35-bc3c-be1c3186c9a2 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:06.966913 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-a9d0c45d-fc8c-4b35-bc3c-be1c3186c9a2 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:06.973357 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a9d0c45d-fc8c-4b35-bc3c-be1c3186c9a2 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:06.973812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a9d0c45d-fc8c-4b35-bc3c-be1c3186c9a2 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:06.974585 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a9d0c45d-fc8c-4b35-bc3c-be1c3186c9a2 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:06.975113 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a9d0c45d-fc8c-4b35-bc3c-be1c3186c9a2 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:07.024400 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-824a4038-5112-4d41-95a7-acc43ef671b9 req-c4c57ea5-fd1e-4514-b066-9b95a1a5c6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ed50de-d8d7-43be-83ab-234b8c5783b3", "name": "network-vif-plugged", "status": "completed", "tag": "0c69eead-8ed3-4a29-b116-0b5d0dbf676c"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:07.037831 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-824a4038-5112-4d41-95a7-acc43ef671b9 req-c4c57ea5-fd1e-4514-b066-9b95a1a5c6f1 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:07.038274 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-824a4038-5112-4d41-95a7-acc43ef671b9 req-c4c57ea5-fd1e-4514-b066-9b95a1a5c6f1 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:07.053688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-824a4038-5112-4d41-95a7-acc43ef671b9 req-c4c57ea5-fd1e-4514-b066-9b95a1a5c6f1 service nova] Creating event network-vif-plugged:0c69eead-8ed3-4a29-b116-0b5d0dbf676c for instance 61ed50de-d8d7-43be-83ab-234b8c5783b3 on hv-cinder-84130 May 10 16:49:07.059200 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-824a4038-5112-4d41-95a7-acc43ef671b9 req-c4c57ea5-fd1e-4514-b066-9b95a1a5c6f1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038766 May 10 16:49:07.060903 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 282/532] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:07.110144 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-a9d0c45d-fc8c-4b35-bc3c-be1c3186c9a2 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:07.117664 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-a9d0c45d-fc8c-4b35-bc3c-be1c3186c9a2 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3" status: 200 len: 1319 microversion: 2.1 time: 0.155281 May 10 16:49:07.118172 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 251/533] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:06 2022] GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:07.971016 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-dcd6ba68-2d0e-48b3-b4eb-cc3e5b108347 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a900f3a4-102b-4864-8b1e-a0da3585e004"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:07.972164 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-dcd6ba68-2d0e-48b3-b4eb-cc3e5b108347 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:07.978283 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dcd6ba68-2d0e-48b3-b4eb-cc3e5b108347 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:07.978732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dcd6ba68-2d0e-48b3-b4eb-cc3e5b108347 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:07.979535 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dcd6ba68-2d0e-48b3-b4eb-cc3e5b108347 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:07.979972 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dcd6ba68-2d0e-48b3-b4eb-cc3e5b108347 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:08.134788 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-164e8ec7-3f81-4ed6-bed7-5df66699c565 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:08.135385 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-164e8ec7-3f81-4ed6-bed7-5df66699c565 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:08.141687 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-164e8ec7-3f81-4ed6-bed7-5df66699c565 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:08.142135 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-164e8ec7-3f81-4ed6-bed7-5df66699c565 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:08.142902 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-164e8ec7-3f81-4ed6-bed7-5df66699c565 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:08.143361 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-164e8ec7-3f81-4ed6-bed7-5df66699c565 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:08.281752 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-164e8ec7-3f81-4ed6-bed7-5df66699c565 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:08.289782 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-164e8ec7-3f81-4ed6-bed7-5df66699c565 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3" status: 200 len: 1319 microversion: 2.1 time: 0.158782 May 10 16:49:08.290354 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 252/534] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:08 2022] GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:08.328087 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-dcd6ba68-2d0e-48b3-b4eb-cc3e5b108347 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "POST /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.361223 May 10 16:49:08.328706 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 283/535] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 16:49:07 2022] POST /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:09.308271 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-fd7c5bc8-1b14-4186-ac6e-4ce1feecbff7 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:09.308886 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-fd7c5bc8-1b14-4186-ac6e-4ce1feecbff7 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:09.315169 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fd7c5bc8-1b14-4186-ac6e-4ce1feecbff7 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:09.315613 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fd7c5bc8-1b14-4186-ac6e-4ce1feecbff7 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:09.316401 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fd7c5bc8-1b14-4186-ac6e-4ce1feecbff7 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:09.316829 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fd7c5bc8-1b14-4186-ac6e-4ce1feecbff7 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:09.453618 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-fd7c5bc8-1b14-4186-ac6e-4ce1feecbff7 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:09.461206 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-fd7c5bc8-1b14-4186-ac6e-4ce1feecbff7 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3" status: 200 len: 1508 microversion: 2.1 time: 0.157539 May 10 16:49:09.461770 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 253/536] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:09 2022] GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:09.479736 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-21dcde3e-cf73-4b44-b4ac-71ba66893211 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0c04672-18d7-46ba-aefa-2ce078fa6f4b", "device": "/dev/sdb"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:09.481435 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-21dcde3e-cf73-4b44-b4ac-71ba66893211 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:09.487834 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-21dcde3e-cf73-4b44-b4ac-71ba66893211 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:09.488281 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-21dcde3e-cf73-4b44-b4ac-71ba66893211 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:09.489050 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-21dcde3e-cf73-4b44-b4ac-71ba66893211 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:09.489487 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-21dcde3e-cf73-4b44-b4ac-71ba66893211 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:09.747324 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-21dcde3e-cf73-4b44-b4ac-71ba66893211 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "POST /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272542 May 10 16:49:09.747927 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 284/537] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 16:49:09 2022] POST /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:16.317015 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1bbc3dbf-b339-432e-8cb1-18f324f35948 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:16.317564 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-1bbc3dbf-b339-432e-8cb1-18f324f35948 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:16.324530 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1bbc3dbf-b339-432e-8cb1-18f324f35948 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:16.324987 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1bbc3dbf-b339-432e-8cb1-18f324f35948 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:16.325764 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1bbc3dbf-b339-432e-8cb1-18f324f35948 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:16.326206 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1bbc3dbf-b339-432e-8cb1-18f324f35948 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:16.357722 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-1bbc3dbf-b339-432e-8cb1-18f324f35948 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments/0a7febec-dcdb-4eb8-be30-8e1743b23dca" status: 200 len: 194 microversion: 2.20 time: 0.044773 May 10 16:49:16.363668 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 254/538] 10.222.0.57 () {60 vars in 1453 bytes} [Tue May 10 16:49:16 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments/0a7febec-dcdb-4eb8-be30-8e1743b23dca => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 16:49:16.421005 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-5cadd442-6b79-4317-a17b-6e8e7f47c20f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:16.421570 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-5cadd442-6b79-4317-a17b-6e8e7f47c20f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:16.428286 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5cadd442-6b79-4317-a17b-6e8e7f47c20f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:16.428736 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5cadd442-6b79-4317-a17b-6e8e7f47c20f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:16.429507 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5cadd442-6b79-4317-a17b-6e8e7f47c20f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:16.429941 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-5cadd442-6b79-4317-a17b-6e8e7f47c20f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:16.509426 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-5cadd442-6b79-4317-a17b-6e8e7f47c20f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lazy-loading 'services' on Instance uuid 82a49eb5-dff1-452f-9e73-a8a9b0c64649 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:49:16.581722 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-5cadd442-6b79-4317-a17b-6e8e7f47c20f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "DELETE /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments/0a7febec-dcdb-4eb8-be30-8e1743b23dca" status: 202 len: 0 microversion: 2.20 time: 0.165390 May 10 16:49:16.582326 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 285/539] 10.222.0.57 () {60 vars in 1456 bytes} [Tue May 10 16:49:16 2022] DELETE /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments/0a7febec-dcdb-4eb8-be30-8e1743b23dca => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 16:49:16.590701 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-29a06ec9-5fcf-424e-83c7-4eb0b29ae39b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:16.591658 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-29a06ec9-5fcf-424e-83c7-4eb0b29ae39b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:16.597559 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-29a06ec9-5fcf-424e-83c7-4eb0b29ae39b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:16.598010 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-29a06ec9-5fcf-424e-83c7-4eb0b29ae39b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:16.598795 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-29a06ec9-5fcf-424e-83c7-4eb0b29ae39b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:16.599631 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-29a06ec9-5fcf-424e-83c7-4eb0b29ae39b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:16.629166 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-29a06ec9-5fcf-424e-83c7-4eb0b29ae39b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042320 May 10 16:49:16.633620 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 255/540] 10.222.0.57 () {60 vars in 1342 bytes} [Tue May 10 16:49:16 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:49:16.851945 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-cbd3c32e-d332-49d9-8f46-0e5011b48584 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:16.853043 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-cbd3c32e-d332-49d9-8f46-0e5011b48584 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:16.859282 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cbd3c32e-d332-49d9-8f46-0e5011b48584 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:16.859833 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cbd3c32e-d332-49d9-8f46-0e5011b48584 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:16.860613 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cbd3c32e-d332-49d9-8f46-0e5011b48584 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:16.861048 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cbd3c32e-d332-49d9-8f46-0e5011b48584 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:16.885592 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-cbd3c32e-d332-49d9-8f46-0e5011b48584 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lazy-loading 'flavor' on Instance uuid be5fc929-1796-4c21-b41c-22850fb9939a {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:49:17.022138 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-cbd3c32e-d332-49d9-8f46-0e5011b48584 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "POST /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/action" status: 200 len: 32 microversion: 2.1 time: 0.174924 May 10 16:49:17.022728 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 286/541] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 16:49:16 2022] POST /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 16:49:17.032384 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-12d125a4-9d92-46ac-a89f-8a34969f7ce8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:17.032996 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-12d125a4-9d92-46ac-a89f-8a34969f7ce8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:17.039146 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-12d125a4-9d92-46ac-a89f-8a34969f7ce8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:17.039602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-12d125a4-9d92-46ac-a89f-8a34969f7ce8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:17.040417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-12d125a4-9d92-46ac-a89f-8a34969f7ce8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:17.042346 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-12d125a4-9d92-46ac-a89f-8a34969f7ce8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:17.173609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-12d125a4-9d92-46ac-a89f-8a34969f7ce8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:17.181757 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-12d125a4-9d92-46ac-a89f-8a34969f7ce8 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1734 microversion: 2.1 time: 0.153880 May 10 16:49:17.182319 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 256/542] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:17 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:17.642664 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-02121e44-b661-451f-9187-27fcbd898597 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:17.643809 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-02121e44-b661-451f-9187-27fcbd898597 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:17.649966 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-02121e44-b661-451f-9187-27fcbd898597 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:17.650414 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-02121e44-b661-451f-9187-27fcbd898597 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:17.651215 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-02121e44-b661-451f-9187-27fcbd898597 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:17.651652 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-02121e44-b661-451f-9187-27fcbd898597 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:17.680652 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-02121e44-b661-451f-9187-27fcbd898597 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042812 May 10 16:49:17.681207 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 287/543] 10.222.0.57 () {60 vars in 1342 bytes} [Tue May 10 16:49:17 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:49:18.198499 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-7595fd12-3089-429f-ba78-448f3b7d2e2e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:18.199144 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-7595fd12-3089-429f-ba78-448f3b7d2e2e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:18.205746 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7595fd12-3089-429f-ba78-448f3b7d2e2e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:18.206198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7595fd12-3089-429f-ba78-448f3b7d2e2e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:18.206982 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7595fd12-3089-429f-ba78-448f3b7d2e2e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:18.207431 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7595fd12-3089-429f-ba78-448f3b7d2e2e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:18.335699 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7595fd12-3089-429f-ba78-448f3b7d2e2e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:18.344535 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-7595fd12-3089-429f-ba78-448f3b7d2e2e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1734 microversion: 2.1 time: 0.149757 May 10 16:49:18.345096 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 257/544] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:18 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:18.692771 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-88cd6988-c86e-4059-b655-3891bf1d01a5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:18.693684 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-88cd6988-c86e-4059-b655-3891bf1d01a5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:18.699998 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-88cd6988-c86e-4059-b655-3891bf1d01a5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:18.700440 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-88cd6988-c86e-4059-b655-3891bf1d01a5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:18.701679 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-88cd6988-c86e-4059-b655-3891bf1d01a5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:18.702662 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-88cd6988-c86e-4059-b655-3891bf1d01a5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:18.731140 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-88cd6988-c86e-4059-b655-3891bf1d01a5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042232 May 10 16:49:18.731736 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 288/545] 10.222.0.57 () {60 vars in 1342 bytes} [Tue May 10 16:49:18 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:49:19.361042 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-cc87d1e4-495b-4cbe-addb-712404fcd562 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:19.361749 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-cc87d1e4-495b-4cbe-addb-712404fcd562 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:19.368067 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-cc87d1e4-495b-4cbe-addb-712404fcd562 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:19.368518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-cc87d1e4-495b-4cbe-addb-712404fcd562 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:19.369283 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-cc87d1e4-495b-4cbe-addb-712404fcd562 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:19.369718 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-cc87d1e4-495b-4cbe-addb-712404fcd562 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:19.497785 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-cc87d1e4-495b-4cbe-addb-712404fcd562 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:19.506300 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-cc87d1e4-495b-4cbe-addb-712404fcd562 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1734 microversion: 2.1 time: 0.149369 May 10 16:49:19.506862 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 258/546] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:19 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:19.742731 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9f4993a4-205e-4351-900e-a2be7943dc4a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:19.743784 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9f4993a4-205e-4351-900e-a2be7943dc4a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:19.750705 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9f4993a4-205e-4351-900e-a2be7943dc4a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:19.751132 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9f4993a4-205e-4351-900e-a2be7943dc4a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:19.751889 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9f4993a4-205e-4351-900e-a2be7943dc4a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:19.752320 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9f4993a4-205e-4351-900e-a2be7943dc4a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:19.779707 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9f4993a4-205e-4351-900e-a2be7943dc4a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040974 May 10 16:49:19.780249 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 289/547] 10.222.0.57 () {60 vars in 1342 bytes} [Tue May 10 16:49:19 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:49:20.524424 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-4f30db8a-282b-449b-9c00-bc3e9f92bd50 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:20.525030 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-4f30db8a-282b-449b-9c00-bc3e9f92bd50 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:20.531955 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4f30db8a-282b-449b-9c00-bc3e9f92bd50 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:20.532394 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4f30db8a-282b-449b-9c00-bc3e9f92bd50 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:20.533162 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4f30db8a-282b-449b-9c00-bc3e9f92bd50 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:20.533591 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4f30db8a-282b-449b-9c00-bc3e9f92bd50 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:20.661792 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-4f30db8a-282b-449b-9c00-bc3e9f92bd50 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:20.670105 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-4f30db8a-282b-449b-9c00-bc3e9f92bd50 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1734 microversion: 2.1 time: 0.149488 May 10 16:49:20.670675 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 259/548] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:20 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:20.790599 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2eeaf173-d4bd-4874-9757-5a5238ffa993 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:20.791480 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2eeaf173-d4bd-4874-9757-5a5238ffa993 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:20.797795 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2eeaf173-d4bd-4874-9757-5a5238ffa993 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:20.798242 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2eeaf173-d4bd-4874-9757-5a5238ffa993 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:20.799075 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2eeaf173-d4bd-4874-9757-5a5238ffa993 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:20.799517 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2eeaf173-d4bd-4874-9757-5a5238ffa993 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:20.828941 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2eeaf173-d4bd-4874-9757-5a5238ffa993 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042290 May 10 16:49:20.829494 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 290/549] 10.222.0.57 () {60 vars in 1342 bytes} [Tue May 10 16:49:20 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:49:21.686283 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-c38909ac-38e3-41cb-86f6-902c4f3200bd tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:21.686889 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-c38909ac-38e3-41cb-86f6-902c4f3200bd tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:21.693133 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c38909ac-38e3-41cb-86f6-902c4f3200bd tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:21.693574 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c38909ac-38e3-41cb-86f6-902c4f3200bd tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:21.694328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c38909ac-38e3-41cb-86f6-902c4f3200bd tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:21.694756 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c38909ac-38e3-41cb-86f6-902c4f3200bd tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:21.818640 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c38909ac-38e3-41cb-86f6-902c4f3200bd tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:21.826532 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-c38909ac-38e3-41cb-86f6-902c4f3200bd tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1734 microversion: 2.1 time: 0.144070 May 10 16:49:21.827187 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 260/550] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:21 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1734 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:21.840818 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9a2595da-04c6-4b42-9126-a3cc1b89aa60 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:21.841745 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9a2595da-04c6-4b42-9126-a3cc1b89aa60 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:21.848537 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9a2595da-04c6-4b42-9126-a3cc1b89aa60 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:21.848989 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9a2595da-04c6-4b42-9126-a3cc1b89aa60 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:21.849783 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9a2595da-04c6-4b42-9126-a3cc1b89aa60 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:21.850216 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9a2595da-04c6-4b42-9126-a3cc1b89aa60 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:21.878329 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9a2595da-04c6-4b42-9126-a3cc1b89aa60 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041502 May 10 16:49:21.879123 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 291/551] 10.222.0.57 () {60 vars in 1342 bytes} [Tue May 10 16:49:21 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:49:22.844715 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-06cca7d2-3c04-4799-8030-79a299963f47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:22.845354 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-06cca7d2-3c04-4799-8030-79a299963f47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:22.851379 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-06cca7d2-3c04-4799-8030-79a299963f47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:22.851825 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-06cca7d2-3c04-4799-8030-79a299963f47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:22.852595 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-06cca7d2-3c04-4799-8030-79a299963f47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:22.853030 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-06cca7d2-3c04-4799-8030-79a299963f47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:22.891168 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-03678303-0692-4078-8cc3-fc2b339bc635 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:22.893558 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-03678303-0692-4078-8cc3-fc2b339bc635 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:22.898513 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-03678303-0692-4078-8cc3-fc2b339bc635 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:22.898981 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-03678303-0692-4078-8cc3-fc2b339bc635 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:22.899798 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-03678303-0692-4078-8cc3-fc2b339bc635 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:22.900237 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-03678303-0692-4078-8cc3-fc2b339bc635 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:22.929803 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-03678303-0692-4078-8cc3-fc2b339bc635 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043551 May 10 16:49:22.930554 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 292/552] 10.222.0.57 () {60 vars in 1342 bytes} [Tue May 10 16:49:22 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 16:49:22.990757 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-06cca7d2-3c04-4799-8030-79a299963f47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:22.999601 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-06cca7d2-3c04-4799-8030-79a299963f47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1734 microversion: 2.1 time: 0.159540 May 10 16:49:23.000230 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 261/553] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:22 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:23.941685 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e289c735-fa93-4ec4-8f38-726b88192b03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:23.942612 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e289c735-fa93-4ec4-8f38-726b88192b03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:23.948895 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e289c735-fa93-4ec4-8f38-726b88192b03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:23.949348 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e289c735-fa93-4ec4-8f38-726b88192b03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:23.950119 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e289c735-fa93-4ec4-8f38-726b88192b03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:23.950559 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e289c735-fa93-4ec4-8f38-726b88192b03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:23.979528 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e289c735-fa93-4ec4-8f38-726b88192b03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041752 May 10 16:49:23.980098 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 293/554] 10.222.0.57 () {60 vars in 1342 bytes} [Tue May 10 16:49:23 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:49:24.016519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-236927d5-9728-4b4b-89b2-e4c701909aa7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:24.017200 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-236927d5-9728-4b4b-89b2-e4c701909aa7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:24.023504 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-236927d5-9728-4b4b-89b2-e4c701909aa7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:24.023956 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-236927d5-9728-4b4b-89b2-e4c701909aa7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:24.024725 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-236927d5-9728-4b4b-89b2-e4c701909aa7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:24.025165 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-236927d5-9728-4b4b-89b2-e4c701909aa7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:24.153490 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-236927d5-9728-4b4b-89b2-e4c701909aa7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:24.161837 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-236927d5-9728-4b4b-89b2-e4c701909aa7 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1734 microversion: 2.1 time: 0.149141 May 10 16:49:24.162409 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 262/555] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:24 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:24.991081 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-485f222b-6f3c-47c5-a90f-529d6a0df68a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:24.991999 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-485f222b-6f3c-47c5-a90f-529d6a0df68a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:24.998451 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-485f222b-6f3c-47c5-a90f-529d6a0df68a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:24.998893 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-485f222b-6f3c-47c5-a90f-529d6a0df68a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:24.999712 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-485f222b-6f3c-47c5-a90f-529d6a0df68a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:25.000144 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-485f222b-6f3c-47c5-a90f-529d6a0df68a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:25.027772 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-485f222b-6f3c-47c5-a90f-529d6a0df68a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040673 May 10 16:49:25.028316 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 294/556] 10.222.0.57 () {60 vars in 1342 bytes} [Tue May 10 16:49:24 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:25.090119 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-130abcf7-c536-4c72-b238-96d29b499471 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:25.090601 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-130abcf7-c536-4c72-b238-96d29b499471 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:25.097484 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-130abcf7-c536-4c72-b238-96d29b499471 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:25.097934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-130abcf7-c536-4c72-b238-96d29b499471 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:25.098691 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-130abcf7-c536-4c72-b238-96d29b499471 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:25.099158 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-130abcf7-c536-4c72-b238-96d29b499471 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:25.122648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-130abcf7-c536-4c72-b238-96d29b499471 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Going to try to terminate instance {{(pid=128925) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:49:25.179593 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2a519a21-6caf-4641-98df-1181170989a9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:25.180298 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2a519a21-6caf-4641-98df-1181170989a9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:25.186034 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a519a21-6caf-4641-98df-1181170989a9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:25.186489 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a519a21-6caf-4641-98df-1181170989a9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:25.187288 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a519a21-6caf-4641-98df-1181170989a9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:25.187727 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2a519a21-6caf-4641-98df-1181170989a9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:25.199321 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-130abcf7-c536-4c72-b238-96d29b499471 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "DELETE /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 204 len: 0 microversion: 2.20 time: 0.112522 May 10 16:49:25.200054 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 263/557] 10.222.0.57 () {60 vars in 1279 bytes} [Tue May 10 16:49:25 2022] DELETE /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 16:49:25.210905 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-ab757792-d6e1-4791-8fc2-91ebba4ee10c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:25.211846 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-ab757792-d6e1-4791-8fc2-91ebba4ee10c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:25.218431 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ab757792-d6e1-4791-8fc2-91ebba4ee10c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:25.218883 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ab757792-d6e1-4791-8fc2-91ebba4ee10c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:25.219853 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ab757792-d6e1-4791-8fc2-91ebba4ee10c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:25.220290 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ab757792-d6e1-4791-8fc2-91ebba4ee10c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:25.391407 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2a519a21-6caf-4641-98df-1181170989a9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:25.395168 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ab757792-d6e1-4791-8fc2-91ebba4ee10c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:25.399142 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2a519a21-6caf-4641-98df-1181170989a9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1734 microversion: 2.1 time: 0.223712 May 10 16:49:25.399708 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 295/558] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:25 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1734 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:25.403127 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ab757792-d6e1-4791-8fc2-91ebba4ee10c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:25.404758 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ab757792-d6e1-4791-8fc2-91ebba4ee10c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:25.405996 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-ab757792-d6e1-4791-8fc2-91ebba4ee10c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1724 microversion: 2.20 time: 0.200139 May 10 16:49:25.406617 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 264/559] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:25 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:26.416204 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-887c90a9-a83e-4909-9cc1-967239d14cf9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:26.416808 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-887c90a9-a83e-4909-9cc1-967239d14cf9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:26.423954 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-887c90a9-a83e-4909-9cc1-967239d14cf9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:26.424411 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-887c90a9-a83e-4909-9cc1-967239d14cf9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:26.424749 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-8a72c982-27fb-4aa9-b5ab-3def0cfad779 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:26.425193 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-887c90a9-a83e-4909-9cc1-967239d14cf9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:26.425362 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-8a72c982-27fb-4aa9-b5ab-3def0cfad779 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:26.425630 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-887c90a9-a83e-4909-9cc1-967239d14cf9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:26.431594 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8a72c982-27fb-4aa9-b5ab-3def0cfad779 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:26.432044 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8a72c982-27fb-4aa9-b5ab-3def0cfad779 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:26.432848 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8a72c982-27fb-4aa9-b5ab-3def0cfad779 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:26.433284 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8a72c982-27fb-4aa9-b5ab-3def0cfad779 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:26.613735 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-887c90a9-a83e-4909-9cc1-967239d14cf9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:26.616925 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-8a72c982-27fb-4aa9-b5ab-3def0cfad779 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:26.621709 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-887c90a9-a83e-4909-9cc1-967239d14cf9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1734 microversion: 2.1 time: 0.209277 May 10 16:49:26.622275 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 296/560] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:26 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:26.625634 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-8a72c982-27fb-4aa9-b5ab-3def0cfad779 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:26.627167 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-8a72c982-27fb-4aa9-b5ab-3def0cfad779 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:26.628322 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-8a72c982-27fb-4aa9-b5ab-3def0cfad779 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1724 microversion: 2.20 time: 0.207486 May 10 16:49:26.628877 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 265/561] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:26 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:49:27.639756 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4fa7288c-05ee-4a7f-a121-a5139b597d3c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:27.640392 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4fa7288c-05ee-4a7f-a121-a5139b597d3c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:27.645691 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-16d57e98-5607-4ecd-82e3-99b2395662ae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:27.646305 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-16d57e98-5607-4ecd-82e3-99b2395662ae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:27.646673 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4fa7288c-05ee-4a7f-a121-a5139b597d3c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:27.647159 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4fa7288c-05ee-4a7f-a121-a5139b597d3c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:27.647923 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4fa7288c-05ee-4a7f-a121-a5139b597d3c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:27.648353 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4fa7288c-05ee-4a7f-a121-a5139b597d3c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:27.652582 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-16d57e98-5607-4ecd-82e3-99b2395662ae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:27.653028 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-16d57e98-5607-4ecd-82e3-99b2395662ae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:27.653796 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-16d57e98-5607-4ecd-82e3-99b2395662ae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:27.654221 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-16d57e98-5607-4ecd-82e3-99b2395662ae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:27.836054 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4fa7288c-05ee-4a7f-a121-a5139b597d3c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:27.840090 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-16d57e98-5607-4ecd-82e3-99b2395662ae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:27.843820 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4fa7288c-05ee-4a7f-a121-a5139b597d3c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1734 microversion: 2.1 time: 0.208527 May 10 16:49:27.844392 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 297/562] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:27 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:27.848072 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-16d57e98-5607-4ecd-82e3-99b2395662ae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:27.849627 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-16d57e98-5607-4ecd-82e3-99b2395662ae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:27.850777 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-16d57e98-5607-4ecd-82e3-99b2395662ae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1724 microversion: 2.20 time: 0.208899 May 10 16:49:27.851349 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 266/563] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:27 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:49:28.860845 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-dc003ac7-b477-42ee-972b-97bbb2fe3f6e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:28.862009 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-dc003ac7-b477-42ee-972b-97bbb2fe3f6e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:28.868090 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc003ac7-b477-42ee-972b-97bbb2fe3f6e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:28.868268 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-58892bea-3b88-4463-95f4-81abf0e0d476 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:28.868686 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc003ac7-b477-42ee-972b-97bbb2fe3f6e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:28.868928 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-58892bea-3b88-4463-95f4-81abf0e0d476 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:28.869289 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc003ac7-b477-42ee-972b-97bbb2fe3f6e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:28.869722 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc003ac7-b477-42ee-972b-97bbb2fe3f6e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:28.884593 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-58892bea-3b88-4463-95f4-81abf0e0d476 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:28.884593 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-58892bea-3b88-4463-95f4-81abf0e0d476 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:28.885415 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-58892bea-3b88-4463-95f4-81abf0e0d476 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:28.885903 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-58892bea-3b88-4463-95f4-81abf0e0d476 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:29.063508 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-dc003ac7-b477-42ee-972b-97bbb2fe3f6e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:29.071562 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-dc003ac7-b477-42ee-972b-97bbb2fe3f6e tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1734 microversion: 2.1 time: 0.214558 May 10 16:49:29.072131 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 298/564] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:28 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:29.094614 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-58892bea-3b88-4463-95f4-81abf0e0d476 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:29.102250 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-58892bea-3b88-4463-95f4-81abf0e0d476 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:29.103803 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-58892bea-3b88-4463-95f4-81abf0e0d476 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:29.104939 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-58892bea-3b88-4463-95f4-81abf0e0d476 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1724 microversion: 2.20 time: 0.240527 May 10 16:49:29.105487 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 267/565] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:28 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:49:30.088987 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4c7dd638-6620-433c-968c-c0dcffafd8b9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:30.089624 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4c7dd638-6620-433c-968c-c0dcffafd8b9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:30.095878 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4c7dd638-6620-433c-968c-c0dcffafd8b9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:30.096322 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4c7dd638-6620-433c-968c-c0dcffafd8b9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:30.097081 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4c7dd638-6620-433c-968c-c0dcffafd8b9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:30.097516 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4c7dd638-6620-433c-968c-c0dcffafd8b9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:30.121942 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-29dfee8b-1275-4dcd-b60e-076ba719eda6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:30.122632 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-29dfee8b-1275-4dcd-b60e-076ba719eda6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:30.129452 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-29dfee8b-1275-4dcd-b60e-076ba719eda6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:30.129902 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-29dfee8b-1275-4dcd-b60e-076ba719eda6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:30.130661 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-29dfee8b-1275-4dcd-b60e-076ba719eda6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:30.131117 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-29dfee8b-1275-4dcd-b60e-076ba719eda6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:30.271700 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4c7dd638-6620-433c-968c-c0dcffafd8b9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:30.279697 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4c7dd638-6620-433c-968c-c0dcffafd8b9 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1734 microversion: 2.1 time: 0.194488 May 10 16:49:30.280272 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 299/566] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:30 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1734 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:30.298623 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-29dfee8b-1275-4dcd-b60e-076ba719eda6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:30.307473 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-29dfee8b-1275-4dcd-b60e-076ba719eda6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:30.310349 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-29dfee8b-1275-4dcd-b60e-076ba719eda6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:30.312157 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-29dfee8b-1275-4dcd-b60e-076ba719eda6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1724 microversion: 2.20 time: 0.194034 May 10 16:49:30.312716 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 268/567] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:30 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:49:31.300658 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c67dcf6a-95a0-4214-ad7c-a5cd3dc5bcaf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:31.301549 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c67dcf6a-95a0-4214-ad7c-a5cd3dc5bcaf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:31.307791 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c67dcf6a-95a0-4214-ad7c-a5cd3dc5bcaf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:31.308238 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c67dcf6a-95a0-4214-ad7c-a5cd3dc5bcaf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:31.308995 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c67dcf6a-95a0-4214-ad7c-a5cd3dc5bcaf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:31.309428 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c67dcf6a-95a0-4214-ad7c-a5cd3dc5bcaf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:31.331408 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-672f51cb-1110-451a-a555-b37860851bb0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:31.332016 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-672f51cb-1110-451a-a555-b37860851bb0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:31.338373 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-672f51cb-1110-451a-a555-b37860851bb0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:31.338824 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-672f51cb-1110-451a-a555-b37860851bb0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:31.339627 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-672f51cb-1110-451a-a555-b37860851bb0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:31.340063 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-672f51cb-1110-451a-a555-b37860851bb0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:31.485070 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c67dcf6a-95a0-4214-ad7c-a5cd3dc5bcaf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:31.492964 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c67dcf6a-95a0-4214-ad7c-a5cd3dc5bcaf tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1734 microversion: 2.1 time: 0.196137 May 10 16:49:31.493620 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 300/568] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:31 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:31.507578 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-672f51cb-1110-451a-a555-b37860851bb0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:31.516152 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-672f51cb-1110-451a-a555-b37860851bb0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:31.517935 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-672f51cb-1110-451a-a555-b37860851bb0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:31.519664 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-672f51cb-1110-451a-a555-b37860851bb0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1724 microversion: 2.20 time: 0.192151 May 10 16:49:31.520271 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 269/569] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:31 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:49:32.510667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-faf85022-52b0-424b-ba1e-5fc06cc194eb tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:32.511382 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-faf85022-52b0-424b-ba1e-5fc06cc194eb tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:32.517912 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-faf85022-52b0-424b-ba1e-5fc06cc194eb tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:32.518362 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-faf85022-52b0-424b-ba1e-5fc06cc194eb tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:32.519155 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-faf85022-52b0-424b-ba1e-5fc06cc194eb tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:32.519590 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-faf85022-52b0-424b-ba1e-5fc06cc194eb tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:32.542130 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-ecfabe65-d09d-469a-8a02-af645533093c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:32.542755 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-ecfabe65-d09d-469a-8a02-af645533093c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:32.549155 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ecfabe65-d09d-469a-8a02-af645533093c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:32.549720 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ecfabe65-d09d-469a-8a02-af645533093c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:32.550521 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ecfabe65-d09d-469a-8a02-af645533093c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:32.550975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ecfabe65-d09d-469a-8a02-af645533093c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:33.037805 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-faf85022-52b0-424b-ba1e-5fc06cc194eb tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:33.042869 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ecfabe65-d09d-469a-8a02-af645533093c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:33.046834 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-faf85022-52b0-424b-ba1e-5fc06cc194eb tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1734 microversion: 2.1 time: 0.540047 May 10 16:49:33.056875 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 301/570] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:32 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1734 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:33.062442 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ecfabe65-d09d-469a-8a02-af645533093c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:33.064384 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ecfabe65-d09d-469a-8a02-af645533093c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:33.065809 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-ecfabe65-d09d-469a-8a02-af645533093c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1724 microversion: 2.20 time: 0.528826 May 10 16:49:33.066704 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 270/571] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:32 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1724 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:49:33.461809 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-40ceb3f9-8d68-4d13-a18f-048a488d7dbf req-4af6a11a-1b6b-4726-87a1-22176eb3594b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a49eb5-dff1-452f-9e73-a8a9b0c64649", "name": "network-vif-deleted", "tag": "0e22ce60-edf0-4181-80b7-08f1d62c396b"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:33.471818 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-40ceb3f9-8d68-4d13-a18f-048a488d7dbf req-4af6a11a-1b6b-4726-87a1-22176eb3594b service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:33.472487 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-40ceb3f9-8d68-4d13-a18f-048a488d7dbf req-4af6a11a-1b6b-4726-87a1-22176eb3594b service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:33.486524 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-40ceb3f9-8d68-4d13-a18f-048a488d7dbf req-4af6a11a-1b6b-4726-87a1-22176eb3594b service nova] Creating event network-vif-deleted:0e22ce60-edf0-4181-80b7-08f1d62c396b for instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 on hv-cinder-84130 May 10 16:49:33.492571 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-40ceb3f9-8d68-4d13-a18f-048a488d7dbf req-4af6a11a-1b6b-4726-87a1-22176eb3594b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034186 May 10 16:49:33.493752 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 302/572] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:34.064633 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-930433c6-d82b-4f1f-ae70-dd6bb3fe49fe tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:34.065278 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-930433c6-d82b-4f1f-ae70-dd6bb3fe49fe tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:34.072994 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-930433c6-d82b-4f1f-ae70-dd6bb3fe49fe tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:34.073467 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-930433c6-d82b-4f1f-ae70-dd6bb3fe49fe tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:34.074451 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-930433c6-d82b-4f1f-ae70-dd6bb3fe49fe tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:34.074975 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-930433c6-d82b-4f1f-ae70-dd6bb3fe49fe tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:34.086791 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-60e8ee94-e01b-45c6-b0ea-19c89b6f15c3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:34.087519 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-60e8ee94-e01b-45c6-b0ea-19c89b6f15c3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:34.105052 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-60e8ee94-e01b-45c6-b0ea-19c89b6f15c3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:34.105507 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-60e8ee94-e01b-45c6-b0ea-19c89b6f15c3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:34.106294 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-60e8ee94-e01b-45c6-b0ea-19c89b6f15c3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:34.107102 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-60e8ee94-e01b-45c6-b0ea-19c89b6f15c3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:34.147515 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-60e8ee94-e01b-45c6-b0ea-19c89b6f15c3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:34.148245 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-60e8ee94-e01b-45c6-b0ea-19c89b6f15c3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:34.148857 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-60e8ee94-e01b-45c6-b0ea-19c89b6f15c3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lazy-loading 'fault' on Instance uuid 82a49eb5-dff1-452f-9e73-a8a9b0c64649 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:49:34.233130 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-60e8ee94-e01b-45c6-b0ea-19c89b6f15c3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:34.246807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-60e8ee94-e01b-45c6-b0ea-19c89b6f15c3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:34.269928 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-60e8ee94-e01b-45c6-b0ea-19c89b6f15c3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:34.276032 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-60e8ee94-e01b-45c6-b0ea-19c89b6f15c3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 200 len: 1372 microversion: 2.20 time: 0.194652 May 10 16:49:34.277070 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 303/573] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:34 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:34.330608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-930433c6-d82b-4f1f-ae70-dd6bb3fe49fe tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:34.343548 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-930433c6-d82b-4f1f-ae70-dd6bb3fe49fe tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1734 microversion: 2.1 time: 0.283360 May 10 16:49:34.344496 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 271/574] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:34 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1734 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:35.296064 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7f9c88a6-f653-4fa2-be38-d97dd1dbbf39 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:35.297342 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7f9c88a6-f653-4fa2-be38-d97dd1dbbf39 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:35.304687 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7f9c88a6-f653-4fa2-be38-d97dd1dbbf39 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:35.305223 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7f9c88a6-f653-4fa2-be38-d97dd1dbbf39 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:35.306785 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7f9c88a6-f653-4fa2-be38-d97dd1dbbf39 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:35.307258 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7f9c88a6-f653-4fa2-be38-d97dd1dbbf39 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:35.325732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-7f9c88a6-f653-4fa2-be38-d97dd1dbbf39 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] HTTP exception thrown: Instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 could not be found. May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7f9c88a6-f653-4fa2-be38-d97dd1dbbf39 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Request method failure captured: May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 HTTP/1.1 May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept: application/json May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Connection: close May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Host: 10.222.0.57 May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABiepaTDXqoJ4_ovIq35g2wdTCUSL_t9BgLVKLOc-1Lbv62T44jzWug_MLB2FVqcAGVusNHua-5h04eios-Ysa-gL1xJbMcieEMRc8nhYiW0nB9bcQkZGYOFFwSoKpfOq0ijmqIrKytckzmyK99XNIBUooNenWeDIC4NgH3wUfvhfOgbhM May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Openstack-Nova-Api-Version: 2.20 May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Id: 3dbc7e862c11480e96d2804301e9796b May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2006008443 May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 10 16:49:35.327901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 10 16:49:35.329331 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:49:35.329331 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2006008443 May 10 16:49:35.329331 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 3dbc7e862c11480e96d2804301e9796b May 10 16:49:35.329331 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2006008443 May 10 16:49:35.329331 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User: tempest-AttachVolumeShelveTestJSON-2006008443-project May 10 16:49:35.329331 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 10 16:49:35.329331 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 10 16:49:35.329331 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Id: 48a7478e69d740e89da1201c954cbfe0 May 10 16:49:35.329331 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2006008443-project May 10 16:49:35.329331 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: method: > May 10 16:49:35.329331 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: exception: Instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 could not be found. May 10 16:49:35.329331 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: action_args: {'id': '82a49eb5-dff1-452f-9e73-a8a9b0c64649'} May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 could not be found. May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:49:35.330167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:49:35.331476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:49:35.331476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:49:35.331476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:49:35.331476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:49:35.331476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:49:35.331476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:49:35.331476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:49:35.331476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 could not be found. May 10 16:49:35.331476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:49:35.331476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:49:35.331476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:49:35.331476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:35.331476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:49:35.331476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:49:35.331476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:49:35.331476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:49:35.331476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 could not be found. May 10 16:49:35.331476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:49:35.332590 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7f9c88a6-f653-4fa2-be38-d97dd1dbbf39 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Returning 404 to user: Instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:49:35.332590 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7f9c88a6-f653-4fa2-be38-d97dd1dbbf39 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 404 len: 111 microversion: 2.20 time: 0.038181 May 10 16:49:35.332590 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 304/575] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:35 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 16:49:35.339961 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-389b0dee-e1fb-4c04-884e-87473beb2e35 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '.version_select at 0x7fdf195ccee0>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:35.362451 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-54912c5a-ab6d-486d-84fa-14bc05339dc2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:35.363189 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-54912c5a-ab6d-486d-84fa-14bc05339dc2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:35.372584 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-54912c5a-ab6d-486d-84fa-14bc05339dc2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:35.373074 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-54912c5a-ab6d-486d-84fa-14bc05339dc2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:35.373865 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-54912c5a-ab6d-486d-84fa-14bc05339dc2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:35.374309 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-54912c5a-ab6d-486d-84fa-14bc05339dc2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:35.378532 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-389b0dee-e1fb-4c04-884e-87473beb2e35 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310767647" status: 204 len: 0 microversion: 2.20 time: 0.044048 May 10 16:49:35.382623 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 272/576] 10.222.0.57 () {60 vars in 1261 bytes} [Tue May 10 16:49:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310767647 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 16:49:35.644854 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-54912c5a-ab6d-486d-84fa-14bc05339dc2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:35.653602 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-54912c5a-ab6d-486d-84fa-14bc05339dc2 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1734 microversion: 2.1 time: 0.296232 May 10 16:49:35.654921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 305/577] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:35 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1734 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:36.216475 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-a3761935-4058-4783-ac7d-5d2a23fb342b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Action: 'create', calling method: .version_select at 0x7fdf196189d0>, body: {"keypair": {"name": "tempest-keypair-61845892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEMUOoppSJL3a+qUuCyYgtYsJy0D0JTB9IbOF1MoVjRRV+9xDvms0O+T0/6Oo5SidLxz1lnoz3O/x6FKQ4Q2niLradtIOEc5/DsJxHZiRvFJXAXLM5mTUtvMF0XULvc4Q=="}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:36.233703 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-a3761935-4058-4783-ac7d-5d2a23fb342b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Getting quotas for project 3dbc7e862c11480e96d2804301e9796b. Resources: {'key_pairs'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:49:36.237456 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-a3761935-4058-4783-ac7d-5d2a23fb342b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Getting quotas for user 48a7478e69d740e89da1201c954cbfe0 and project 3dbc7e862c11480e96d2804301e9796b. Resources: {'key_pairs'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:49:36.260135 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-a3761935-4058-4783-ac7d-5d2a23fb342b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.047610 May 10 16:49:36.260726 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 273/578] 10.222.0.57 () {62 vars in 1199 bytes} [Tue May 10 16:49:36 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 16:49:36.464882 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-dadbb149-4042-4a65-a38d-76845e11e931 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:36.465442 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-dadbb149-4042-4a65-a38d-76845e11e931 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:36.472314 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dadbb149-4042-4a65-a38d-76845e11e931 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:36.472773 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dadbb149-4042-4a65-a38d-76845e11e931 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:36.473560 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dadbb149-4042-4a65-a38d-76845e11e931 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:36.473996 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dadbb149-4042-4a65-a38d-76845e11e931 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:36.565384 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-dadbb149-4042-4a65-a38d-76845e11e931 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lazy-loading 'services' on Instance uuid 61ed50de-d8d7-43be-83ab-234b8c5783b3 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:49:36.637600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-dadbb149-4042-4a65-a38d-76845e11e931 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "DELETE /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3/os-volume_attachments/b0c04672-18d7-46ba-aefa-2ce078fa6f4b" status: 202 len: 0 microversion: 2.1 time: 0.176450 May 10 16:49:36.638185 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 306/579] 10.222.0.57 () {58 vars in 1415 bytes} [Tue May 10 16:49:36 2022] DELETE /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3/os-volume_attachments/b0c04672-18d7-46ba-aefa-2ce078fa6f4b => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:49:36.673721 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-fd29d53d-eaa1-437b-a27f-0a154ecafafb tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:36.674349 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-fd29d53d-eaa1-437b-a27f-0a154ecafafb tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:36.681088 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fd29d53d-eaa1-437b-a27f-0a154ecafafb tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:36.681541 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fd29d53d-eaa1-437b-a27f-0a154ecafafb tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:36.682320 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fd29d53d-eaa1-437b-a27f-0a154ecafafb tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:36.682758 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fd29d53d-eaa1-437b-a27f-0a154ecafafb tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:36.893841 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-fd29d53d-eaa1-437b-a27f-0a154ecafafb tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:36.901887 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-fd29d53d-eaa1-437b-a27f-0a154ecafafb tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1734 microversion: 2.1 time: 0.233785 May 10 16:49:36.902556 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 274/580] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:36 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1734 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:37.626283 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-cbb47b9d-c7f4-4892-8eee-17ae0f096a63 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-232993995", "imageRef": "3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "23609351-96c5-4115-8ab9-1dea233ad75a"}], "security_groups": [{"name": "tempest-securitygroup--1503470660"}], "key_name": "tempest-keypair-61845892", "user_data": "}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:37.726036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-cbb47b9d-c7f4-4892-8eee-17ae0f096a63 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] validate_networks() for [('23609351-96c5-4115-8ab9-1dea233ad75a', None, None, None, None, None)] {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:49:37.919603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-6c48c882-fc91-469c-95f3-d76f956faa81 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:37.920411 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-6c48c882-fc91-469c-95f3-d76f956faa81 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:37.927234 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6c48c882-fc91-469c-95f3-d76f956faa81 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:37.927715 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6c48c882-fc91-469c-95f3-d76f956faa81 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:37.928487 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6c48c882-fc91-469c-95f3-d76f956faa81 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:37.928927 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6c48c882-fc91-469c-95f3-d76f956faa81 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:38.132756 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6c48c882-fc91-469c-95f3-d76f956faa81 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:38.141846 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-6c48c882-fc91-469c-95f3-d76f956faa81 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1714 microversion: 2.1 time: 0.226007 May 10 16:49:38.142838 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 275/581] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:37 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1714 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:49:38.168253 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-cbb47b9d-c7f4-4892-8eee-17ae0f096a63 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:49:38.168708 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-cbb47b9d-c7f4-4892-8eee-17ae0f096a63 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:49:38.169182 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-cbb47b9d-c7f4-4892-8eee-17ae0f096a63 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:49:38.169617 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-cbb47b9d-c7f4-4892-8eee-17ae0f096a63 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:49:38.170079 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-cbb47b9d-c7f4-4892-8eee-17ae0f096a63 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:49:38.179586 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cbb47b9d-c7f4-4892-8eee-17ae0f096a63 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:38.180031 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cbb47b9d-c7f4-4892-8eee-17ae0f096a63 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:38.180912 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cbb47b9d-c7f4-4892-8eee-17ae0f096a63 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:38.181347 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-cbb47b9d-c7f4-4892-8eee-17ae0f096a63 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:38.200802 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-cbb47b9d-c7f4-4892-8eee-17ae0f096a63 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Getting quotas for project 3dbc7e862c11480e96d2804301e9796b. Resources: {'instances', 'cores', 'ram'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:49:38.205342 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-cbb47b9d-c7f4-4892-8eee-17ae0f096a63 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Getting quotas for user 48a7478e69d740e89da1201c954cbfe0 and project 3dbc7e862c11480e96d2804301e9796b. Resources: {'instances', 'cores', 'ram'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:49:38.217459 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-cbb47b9d-c7f4-4892-8eee-17ae0f096a63 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:49:38.219845 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-cbb47b9d-c7f4-4892-8eee-17ae0f096a63 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:49:38.247044 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-3a447f99-dc20-4a30-8ae8-0ae36de17c7c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:38.247451 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-3a447f99-dc20-4a30-8ae8-0ae36de17c7c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:38.254019 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3a447f99-dc20-4a30-8ae8-0ae36de17c7c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:38.254468 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3a447f99-dc20-4a30-8ae8-0ae36de17c7c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:38.255274 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3a447f99-dc20-4a30-8ae8-0ae36de17c7c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:38.255711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-3a447f99-dc20-4a30-8ae8-0ae36de17c7c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:38.267956 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-cbb47b9d-c7f4-4892-8eee-17ae0f096a63 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.647215 May 10 16:49:38.271071 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 307/582] 10.222.0.57 () {62 vars in 1187 bytes} [Tue May 10 16:49:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 16:49:38.279729 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-61f9cddf-ef3c-4b7f-a548-272eda6d0dd1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:38.280471 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-61f9cddf-ef3c-4b7f-a548-272eda6d0dd1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:38.338858 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-61f9cddf-ef3c-4b7f-a548-272eda6d0dd1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:38.352563 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-61f9cddf-ef3c-4b7f-a548-272eda6d0dd1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:38.354071 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-61f9cddf-ef3c-4b7f-a548-272eda6d0dd1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:38.355187 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-61f9cddf-ef3c-4b7f-a548-272eda6d0dd1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1279 microversion: 2.20 time: 0.080009 May 10 16:49:38.359005 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 308/583] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:38 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1279 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:38.389072 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.wsgi [None req-3a447f99-dc20-4a30-8ae8-0ae36de17c7c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] HTTP exception thrown: Cannot 'detach_volume' instance be5fc929-1796-4c21-b41c-22850fb9939a while it is in vm_state rescued May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-3a447f99-dc20-4a30-8ae8-0ae36de17c7c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Request method failure captured: May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: DELETE /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/os-volume_attachments/a900f3a4-102b-4864-8b1e-a0da3585e004 HTTP/1.1 May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 0 May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepaUs505RQb-_itGhyItx6PoanxzUvVOQgaz_1Jo9glXWxcoGigpc5wkoPzDRwl-I4vB-wQ4_MxKAUesI6TqrOzBjlBZp69C5J2KLGz6296qMQ3sfqFgSCkXy2WF5NYGkfCnzgy0j3R-znN6Hy6TdvWyTAdluuxXRqfc6leOvHCnPYM May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: c0da2d582ad649208e7c4105faee8290 May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1303242210 May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:49:38.390711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:49:38.392389 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c0da2d582ad649208e7c4105faee8290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0da2d582ad649208e7c4105faee8290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0da2d582ad649208e7c4105faee8290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c0da2d582ad649208e7c4105faee8290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:49:38.392389 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1303242210 May 10 16:49:38.392389 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: c0da2d582ad649208e7c4105faee8290 May 10 16:49:38.392389 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1303242210 May 10 16:49:38.392389 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-ServerRescueNegativeTestJSON-1303242210-project May 10 16:49:38.392389 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:49:38.392389 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:49:38.392389 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: de5e76d5385f44fab03527751a478f1e May 10 16:49:38.392389 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1303242210-project May 10 16:49:38.392389 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: > May 10 16:49:38.392389 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Cannot 'detach_volume' instance be5fc929-1796-4c21-b41c-22850fb9939a while it is in vm_state rescued May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'server_id': 'be5fc929-1796-4c21-b41c-22850fb9939a', 'id': 'a900f3a4-102b-4864-8b1e-a0da3585e004'} May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance be5fc929-1796-4c21-b41c-22850fb9939a in vm_state rescued. Cannot detach_volume while the instance is in this state. May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:49:38.393586 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:49:38.395520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 10 16:49:38.395520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 16:49:38.395520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 16:49:38.395520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 16:49:38.395520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance be5fc929-1796-4c21-b41c-22850fb9939a while it is in vm_state rescued May 10 16:49:38.395520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:49:38.395520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:49:38.395520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:49:38.395520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:38.395520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:49:38.395520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:49:38.395520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:49:38.395520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:49:38.395520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance be5fc929-1796-4c21-b41c-22850fb9939a while it is in vm_state rescued May 10 16:49:38.395520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:49:38.395520 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-3a447f99-dc20-4a30-8ae8-0ae36de17c7c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Returning 409 to user: Cannot 'detach_volume' instance be5fc929-1796-4c21-b41c-22850fb9939a while it is in vm_state rescued {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:49:38.396847 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-3a447f99-dc20-4a30-8ae8-0ae36de17c7c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "DELETE /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/os-volume_attachments/a900f3a4-102b-4864-8b1e-a0da3585e004" status: 409 len: 152 microversion: 2.1 time: 0.149376 May 10 16:49:38.396847 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 276/584] 10.222.0.57 () {58 vars in 1415 bytes} [Tue May 10 16:49:38 2022] DELETE /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/os-volume_attachments/a900f3a4-102b-4864-8b1e-a0da3585e004 => generated 152 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 10 16:49:38.400848 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1b1985ae-6fd6-42d5-a381-6b8dd033148a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:38.401385 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1b1985ae-6fd6-42d5-a381-6b8dd033148a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:38.407957 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b1985ae-6fd6-42d5-a381-6b8dd033148a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:38.408407 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b1985ae-6fd6-42d5-a381-6b8dd033148a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:38.409441 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b1985ae-6fd6-42d5-a381-6b8dd033148a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:38.409876 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b1985ae-6fd6-42d5-a381-6b8dd033148a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:38.478456 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1b1985ae-6fd6-42d5-a381-6b8dd033148a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "POST /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/action" status: 202 len: 0 microversion: 2.1 time: 0.080495 May 10 16:49:38.482891 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 309/585] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 16:49:38 2022] POST /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:49:38.488534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-73dd3775-dd26-45fc-a677-3870a5177e1f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:38.489152 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-73dd3775-dd26-45fc-a677-3870a5177e1f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:38.495535 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-73dd3775-dd26-45fc-a677-3870a5177e1f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:38.495986 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-73dd3775-dd26-45fc-a677-3870a5177e1f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:38.496764 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-73dd3775-dd26-45fc-a677-3870a5177e1f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:38.497193 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-73dd3775-dd26-45fc-a677-3870a5177e1f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:38.706041 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-73dd3775-dd26-45fc-a677-3870a5177e1f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:38.724787 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-73dd3775-dd26-45fc-a677-3870a5177e1f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1722 microversion: 2.1 time: 0.239965 May 10 16:49:38.725475 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 277/586] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:38 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:38.805200 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-16fad06c-f020-4ba8-80e4-6d56d9b572ae tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:38.805719 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-16fad06c-f020-4ba8-80e4-6d56d9b572ae tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:38.812095 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-16fad06c-f020-4ba8-80e4-6d56d9b572ae tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:38.812546 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-16fad06c-f020-4ba8-80e4-6d56d9b572ae tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:38.813322 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-16fad06c-f020-4ba8-80e4-6d56d9b572ae tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:38.813954 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-16fad06c-f020-4ba8-80e4-6d56d9b572ae tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:38.840202 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-16fad06c-f020-4ba8-80e4-6d56d9b572ae tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:49:38.925207 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-16fad06c-f020-4ba8-80e4-6d56d9b572ae tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "DELETE /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3" status: 204 len: 0 microversion: 2.1 time: 0.124254 May 10 16:49:38.925792 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 310/587] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 16:49:38 2022] DELETE /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:49:38.933958 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1d14d89f-3e36-496b-8402-8150240d2dc5 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:38.934575 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-1d14d89f-3e36-496b-8402-8150240d2dc5 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:38.940938 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1d14d89f-3e36-496b-8402-8150240d2dc5 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:38.941390 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1d14d89f-3e36-496b-8402-8150240d2dc5 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:38.942161 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1d14d89f-3e36-496b-8402-8150240d2dc5 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:38.942602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1d14d89f-3e36-496b-8402-8150240d2dc5 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:39.068481 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-1d14d89f-3e36-496b-8402-8150240d2dc5 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:39.075979 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-1d14d89f-3e36-496b-8402-8150240d2dc5 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3" status: 200 len: 1514 microversion: 2.1 time: 0.145708 May 10 16:49:39.076580 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 278/588] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:38 2022] GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:39.373338 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0e6cb623-83d3-4995-b588-3337fd5b71cc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:39.373960 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0e6cb623-83d3-4995-b588-3337fd5b71cc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:39.380248 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0e6cb623-83d3-4995-b588-3337fd5b71cc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:39.380701 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0e6cb623-83d3-4995-b588-3337fd5b71cc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:39.381473 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0e6cb623-83d3-4995-b588-3337fd5b71cc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:39.381912 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0e6cb623-83d3-4995-b588-3337fd5b71cc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:39.444311 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0e6cb623-83d3-4995-b588-3337fd5b71cc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:39.452584 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0e6cb623-83d3-4995-b588-3337fd5b71cc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:39.454096 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0e6cb623-83d3-4995-b588-3337fd5b71cc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:39.455230 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0e6cb623-83d3-4995-b588-3337fd5b71cc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1339 microversion: 2.20 time: 0.086305 May 10 16:49:39.455779 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 311/589] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:39 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1339 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:39.742698 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-48c63982-165f-457f-a5ee-32e96cebb54a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:39.743352 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-48c63982-165f-457f-a5ee-32e96cebb54a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:39.749760 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-48c63982-165f-457f-a5ee-32e96cebb54a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:39.750210 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-48c63982-165f-457f-a5ee-32e96cebb54a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:39.751048 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-48c63982-165f-457f-a5ee-32e96cebb54a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:39.751509 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-48c63982-165f-457f-a5ee-32e96cebb54a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:39.877499 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-48c63982-165f-457f-a5ee-32e96cebb54a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:39.886144 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-48c63982-165f-457f-a5ee-32e96cebb54a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1722 microversion: 2.1 time: 0.146881 May 10 16:49:39.886286 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 279/590] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:39 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:40.093653 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e5d39d71-6df1-4b54-9500-d9d643d56862 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:40.094229 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e5d39d71-6df1-4b54-9500-d9d643d56862 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:40.100214 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e5d39d71-6df1-4b54-9500-d9d643d56862 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:40.100669 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e5d39d71-6df1-4b54-9500-d9d643d56862 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:40.101442 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e5d39d71-6df1-4b54-9500-d9d643d56862 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:40.101886 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e5d39d71-6df1-4b54-9500-d9d643d56862 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:40.230559 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e5d39d71-6df1-4b54-9500-d9d643d56862 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:40.237771 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e5d39d71-6df1-4b54-9500-d9d643d56862 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3" status: 200 len: 1514 microversion: 2.1 time: 0.148696 May 10 16:49:40.238338 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 312/591] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:40 2022] GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:40.473215 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-4d80bd9d-fdfe-46db-ae6d-6995c9909681 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:40.473826 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-4d80bd9d-fdfe-46db-ae6d-6995c9909681 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:40.480122 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4d80bd9d-fdfe-46db-ae6d-6995c9909681 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:40.480568 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4d80bd9d-fdfe-46db-ae6d-6995c9909681 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:40.481327 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4d80bd9d-fdfe-46db-ae6d-6995c9909681 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:40.481760 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4d80bd9d-fdfe-46db-ae6d-6995c9909681 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:40.542399 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-4d80bd9d-fdfe-46db-ae6d-6995c9909681 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:40.550302 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-4d80bd9d-fdfe-46db-ae6d-6995c9909681 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:40.552108 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-4d80bd9d-fdfe-46db-ae6d-6995c9909681 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:40.553233 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-4d80bd9d-fdfe-46db-ae6d-6995c9909681 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1339 microversion: 2.20 time: 0.083899 May 10 16:49:40.553785 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 280/592] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:40 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1339 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:40.903483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2775ebc6-faf2-48ac-9fe2-46885b6a9f47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:40.904103 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2775ebc6-faf2-48ac-9fe2-46885b6a9f47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:40.910460 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2775ebc6-faf2-48ac-9fe2-46885b6a9f47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:40.910912 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2775ebc6-faf2-48ac-9fe2-46885b6a9f47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:40.911727 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2775ebc6-faf2-48ac-9fe2-46885b6a9f47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:40.912200 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2775ebc6-faf2-48ac-9fe2-46885b6a9f47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:41.075665 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2775ebc6-faf2-48ac-9fe2-46885b6a9f47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:41.083316 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2775ebc6-faf2-48ac-9fe2-46885b6a9f47 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1722 microversion: 2.1 time: 0.183604 May 10 16:49:41.083886 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 313/593] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:40 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:41.254649 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b33ead62-aa24-4e3f-8474-2f8e2f96afc3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:41.255290 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-b33ead62-aa24-4e3f-8474-2f8e2f96afc3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:41.261169 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b33ead62-aa24-4e3f-8474-2f8e2f96afc3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:41.261623 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b33ead62-aa24-4e3f-8474-2f8e2f96afc3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:41.262396 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b33ead62-aa24-4e3f-8474-2f8e2f96afc3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:41.262835 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b33ead62-aa24-4e3f-8474-2f8e2f96afc3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:41.393005 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b33ead62-aa24-4e3f-8474-2f8e2f96afc3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:41.400466 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b33ead62-aa24-4e3f-8474-2f8e2f96afc3 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3" status: 200 len: 1514 microversion: 2.1 time: 0.149579 May 10 16:49:41.401042 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 281/594] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:41 2022] GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:41.571478 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b2b90e00-6537-428b-8b5f-b596bb4d5c7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:41.572104 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b2b90e00-6537-428b-8b5f-b596bb4d5c7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:41.578657 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b2b90e00-6537-428b-8b5f-b596bb4d5c7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:41.579126 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b2b90e00-6537-428b-8b5f-b596bb4d5c7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:41.579912 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b2b90e00-6537-428b-8b5f-b596bb4d5c7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:41.580344 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b2b90e00-6537-428b-8b5f-b596bb4d5c7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:41.705220 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b2b90e00-6537-428b-8b5f-b596bb4d5c7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:41.713410 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b2b90e00-6537-428b-8b5f-b596bb4d5c7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:41.714848 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b2b90e00-6537-428b-8b5f-b596bb4d5c7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:41.716006 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b2b90e00-6537-428b-8b5f-b596bb4d5c7c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1405 microversion: 2.20 time: 0.148453 May 10 16:49:41.716569 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 314/595] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:41 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:42.101609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-6015e35d-4841-4d0e-a059-d0f841eee840 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:42.102218 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-6015e35d-4841-4d0e-a059-d0f841eee840 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:42.108630 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6015e35d-4841-4d0e-a059-d0f841eee840 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:42.109082 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6015e35d-4841-4d0e-a059-d0f841eee840 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:42.109853 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6015e35d-4841-4d0e-a059-d0f841eee840 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:42.110295 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6015e35d-4841-4d0e-a059-d0f841eee840 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:42.326114 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6015e35d-4841-4d0e-a059-d0f841eee840 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:42.335094 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-6015e35d-4841-4d0e-a059-d0f841eee840 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1722 microversion: 2.1 time: 0.237212 May 10 16:49:42.335913 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 282/596] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:42 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:42.417927 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9e7644f3-435d-415d-8f59-5f587df1a740 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:42.418461 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9e7644f3-435d-415d-8f59-5f587df1a740 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:42.425471 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9e7644f3-435d-415d-8f59-5f587df1a740 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:42.425922 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9e7644f3-435d-415d-8f59-5f587df1a740 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:42.427315 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9e7644f3-435d-415d-8f59-5f587df1a740 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:42.427763 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9e7644f3-435d-415d-8f59-5f587df1a740 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:42.640242 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9e7644f3-435d-415d-8f59-5f587df1a740 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f1e7854604414e8174b87e039ef401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4278fddbd44cbb508e4fa63f9f7a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:42.648975 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9e7644f3-435d-415d-8f59-5f587df1a740 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3" status: 200 len: 1514 microversion: 2.1 time: 0.235133 May 10 16:49:42.649982 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 315/597] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:42 2022] GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3 => generated 1514 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:42.695111 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-3f1bc9f4-51d1-442f-a47e-c11ad5d128eb req-704dbd85-91fa-4c66-84ed-e7e2dd34573d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61ed50de-d8d7-43be-83ab-234b8c5783b3", "name": "network-vif-deleted", "tag": "0c69eead-8ed3-4a29-b116-0b5d0dbf676c"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:42.706096 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-3f1bc9f4-51d1-442f-a47e-c11ad5d128eb req-704dbd85-91fa-4c66-84ed-e7e2dd34573d service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:42.706542 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-3f1bc9f4-51d1-442f-a47e-c11ad5d128eb req-704dbd85-91fa-4c66-84ed-e7e2dd34573d service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:42.721263 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-3f1bc9f4-51d1-442f-a47e-c11ad5d128eb req-704dbd85-91fa-4c66-84ed-e7e2dd34573d service nova] Creating event network-vif-deleted:0c69eead-8ed3-4a29-b116-0b5d0dbf676c for instance 61ed50de-d8d7-43be-83ab-234b8c5783b3 on hv-cinder-84130 May 10 16:49:42.726564 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-3f1bc9f4-51d1-442f-a47e-c11ad5d128eb req-704dbd85-91fa-4c66-84ed-e7e2dd34573d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036425 May 10 16:49:42.727196 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 283/598] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:42.734818 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4986d6ff-18eb-4f4f-8330-f526ee997b0b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:42.735527 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4986d6ff-18eb-4f4f-8330-f526ee997b0b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:42.741719 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4986d6ff-18eb-4f4f-8330-f526ee997b0b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:42.742172 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4986d6ff-18eb-4f4f-8330-f526ee997b0b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:42.743225 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4986d6ff-18eb-4f4f-8330-f526ee997b0b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:42.743869 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4986d6ff-18eb-4f4f-8330-f526ee997b0b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:42.839194 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-889ffc10-7887-4438-a88b-acc5bcb5239a req-06a68f52-69e4-4d5b-af67-bdb39ecfc909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97528e0b-5eec-4ed3-aa10-b4d56c9803ca", "tag": "f3864dfb-e0b5-4e42-879e-b9da171ec437"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:42.853811 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-889ffc10-7887-4438-a88b-acc5bcb5239a req-06a68f52-69e4-4d5b-af67-bdb39ecfc909 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:42.855742 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-889ffc10-7887-4438-a88b-acc5bcb5239a req-06a68f52-69e4-4d5b-af67-bdb39ecfc909 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:42.897918 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-889ffc10-7887-4438-a88b-acc5bcb5239a req-06a68f52-69e4-4d5b-af67-bdb39ecfc909 service nova] Creating event network-changed:f3864dfb-e0b5-4e42-879e-b9da171ec437 for instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca on hv-cinder-84130 May 10 16:49:42.904371 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-889ffc10-7887-4438-a88b-acc5bcb5239a req-06a68f52-69e4-4d5b-af67-bdb39ecfc909 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069042 May 10 16:49:42.904564 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4986d6ff-18eb-4f4f-8330-f526ee997b0b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:42.906710 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 284/599] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:42.922663 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4986d6ff-18eb-4f4f-8330-f526ee997b0b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:42.924522 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4986d6ff-18eb-4f4f-8330-f526ee997b0b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:42.926095 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4986d6ff-18eb-4f4f-8330-f526ee997b0b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1405 microversion: 2.20 time: 0.195849 May 10 16:49:42.931019 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 316/600] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:42 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:43.353655 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b0c651d6-00c1-4df3-9d5c-b9e3d58593e1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:43.354426 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-b0c651d6-00c1-4df3-9d5c-b9e3d58593e1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:43.361516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b0c651d6-00c1-4df3-9d5c-b9e3d58593e1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:43.362110 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b0c651d6-00c1-4df3-9d5c-b9e3d58593e1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:43.362890 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b0c651d6-00c1-4df3-9d5c-b9e3d58593e1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:43.363567 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b0c651d6-00c1-4df3-9d5c-b9e3d58593e1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:43.515634 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b0c651d6-00c1-4df3-9d5c-b9e3d58593e1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:43.524197 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b0c651d6-00c1-4df3-9d5c-b9e3d58593e1 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1728 microversion: 2.1 time: 0.175234 May 10 16:49:43.524786 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 285/601] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:43 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:49:43.540872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-136345d7-df1b-4b2d-b0bd-9756003d9c8c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:43.541376 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-136345d7-df1b-4b2d-b0bd-9756003d9c8c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:43.548411 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-136345d7-df1b-4b2d-b0bd-9756003d9c8c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:43.548847 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-136345d7-df1b-4b2d-b0bd-9756003d9c8c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:43.549647 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-136345d7-df1b-4b2d-b0bd-9756003d9c8c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:43.550121 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-136345d7-df1b-4b2d-b0bd-9756003d9c8c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:43.634252 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-136345d7-df1b-4b2d-b0bd-9756003d9c8c tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097289 May 10 16:49:43.634855 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 317/602] 10.222.0.57 () {58 vars in 1274 bytes} [Tue May 10 16:49:43 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:43.666648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-5c43fad1-6d88-40b3-b2e0-92849bc29285 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:43.667443 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-5c43fad1-6d88-40b3-b2e0-92849bc29285 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] [instance: 61ed50de-d8d7-43be-83ab-234b8c5783b3] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:43.674106 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5c43fad1-6d88-40b3-b2e0-92849bc29285 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:43.674636 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5c43fad1-6d88-40b3-b2e0-92849bc29285 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:43.675537 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5c43fad1-6d88-40b3-b2e0-92849bc29285 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:43.676046 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5c43fad1-6d88-40b3-b2e0-92849bc29285 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:43.691436 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.wsgi [None req-5c43fad1-6d88-40b3-b2e0-92849bc29285 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] HTTP exception thrown: Instance 61ed50de-d8d7-43be-83ab-234b8c5783b3 could not be found. May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-5c43fad1-6d88-40b3-b2e0-92849bc29285 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Request method failure captured: May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3 HTTP/1.1 May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 0 May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepcL7Y-MwgdxOwwjoLDONtgPUnp7vYHjUjIgzdh34DM0PJCInlezbxdiXXsbKmL3KiAylggGWzhxmRBoqjYy0E_6BXF5F1xp_ixv7tDAhZViHJNXw8YD6kRPr0E0OLm27a7oKdCGhrs79y9XbbpWpn5h5IiJsn-FndutQoJBpzIlD28 May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: aae4278fddbd44cbb508e4fa63f9f7a4 May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-VolumesSnapshotTestJSON-668485509 May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:49:43.693984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:49:43.695719 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/aae4278fddbd44cbb508e4fa63f9f7a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aae4278fddbd44cbb508e4fa63f9f7a4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/aae4278fddbd44cbb508e4fa63f9f7a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_aae4278fddbd44cbb508e4fa63f9f7a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:49:43.695719 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-VolumesSnapshotTestJSON-668485509 May 10 16:49:43.695719 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: aae4278fddbd44cbb508e4fa63f9f7a4 May 10 16:49:43.695719 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-668485509 May 10 16:49:43.695719 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-VolumesSnapshotTestJSON-668485509-project May 10 16:49:43.695719 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:49:43.695719 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:49:43.695719 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: 80f1e7854604414e8174b87e039ef401 May 10 16:49:43.695719 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-VolumesSnapshotTestJSON-668485509-project May 10 16:49:43.695719 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: > May 10 16:49:43.695719 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Instance 61ed50de-d8d7-43be-83ab-234b8c5783b3 could not be found. May 10 16:49:43.695719 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'id': '61ed50de-d8d7-43be-83ab-234b8c5783b3'} May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ed50de-d8d7-43be-83ab-234b8c5783b3 could not be found. May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:49:43.697609 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:49:43.703315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:49:43.703315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:49:43.703315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:49:43.703315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:49:43.703315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:49:43.703315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:49:43.703315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:49:43.703315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ed50de-d8d7-43be-83ab-234b8c5783b3 could not be found. May 10 16:49:43.703315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:49:43.703315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:49:43.703315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:49:43.703315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:49:43.703315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:49:43.703315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:49:43.703315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:49:43.703315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:49:43.703315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ed50de-d8d7-43be-83ab-234b8c5783b3 could not be found. May 10 16:49:43.703315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:49:43.704502 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-5c43fad1-6d88-40b3-b2e0-92849bc29285 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] Returning 404 to user: Instance 61ed50de-d8d7-43be-83ab-234b8c5783b3 could not be found. {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:49:43.704502 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-5c43fad1-6d88-40b3-b2e0-92849bc29285 tempest-VolumesSnapshotTestJSON-668485509 tempest-VolumesSnapshotTestJSON-668485509-project] 10.222.0.57 "GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3" status: 404 len: 111 microversion: 2.1 time: 0.032772 May 10 16:49:43.704502 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 286/603] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:49:43 2022] GET /compute/v2.1/servers/61ed50de-d8d7-43be-83ab-234b8c5783b3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:49:43.946746 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3b856b32-397f-4627-ae44-2d339d905676 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:43.946746 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3b856b32-397f-4627-ae44-2d339d905676 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:43.954453 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3b856b32-397f-4627-ae44-2d339d905676 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:43.955141 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3b856b32-397f-4627-ae44-2d339d905676 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:43.956155 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3b856b32-397f-4627-ae44-2d339d905676 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:43.956704 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3b856b32-397f-4627-ae44-2d339d905676 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:44.407796 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3b856b32-397f-4627-ae44-2d339d905676 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:44.415832 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3b856b32-397f-4627-ae44-2d339d905676 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:44.417403 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3b856b32-397f-4627-ae44-2d339d905676 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:44.418689 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3b856b32-397f-4627-ae44-2d339d905676 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1405 microversion: 2.20 time: 0.478282 May 10 16:49:44.419277 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 318/604] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:43 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:44.943714 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-2f7933a1-fcfb-49f4-9f24-14009751c390 req-a737be9c-6ed5-40c6-a255-3d7065e9348d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be5fc929-1796-4c21-b41c-22850fb9939a", "tag": "043f55c8-7e1c-4a48-89b8-c52b9ab8066b"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:44.955373 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-2f7933a1-fcfb-49f4-9f24-14009751c390 req-a737be9c-6ed5-40c6-a255-3d7065e9348d service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:44.956042 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-2f7933a1-fcfb-49f4-9f24-14009751c390 req-a737be9c-6ed5-40c6-a255-3d7065e9348d service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:44.968909 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-2f7933a1-fcfb-49f4-9f24-14009751c390 req-a737be9c-6ed5-40c6-a255-3d7065e9348d service nova] Creating event network-changed:043f55c8-7e1c-4a48-89b8-c52b9ab8066b for instance be5fc929-1796-4c21-b41c-22850fb9939a on hv-cinder-84130 May 10 16:49:44.973781 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-2f7933a1-fcfb-49f4-9f24-14009751c390 req-a737be9c-6ed5-40c6-a255-3d7065e9348d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033665 May 10 16:49:44.974439 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 287/605] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:45.437910 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-dc36b850-59a9-43bf-850e-3be6ae1fad03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:45.438754 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-dc36b850-59a9-43bf-850e-3be6ae1fad03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:45.445968 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc36b850-59a9-43bf-850e-3be6ae1fad03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:45.446433 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc36b850-59a9-43bf-850e-3be6ae1fad03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:45.447214 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc36b850-59a9-43bf-850e-3be6ae1fad03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:45.447662 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-dc36b850-59a9-43bf-850e-3be6ae1fad03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:45.585205 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-dc36b850-59a9-43bf-850e-3be6ae1fad03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:45.593535 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-dc36b850-59a9-43bf-850e-3be6ae1fad03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:45.595047 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-dc36b850-59a9-43bf-850e-3be6ae1fad03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:45.596140 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-dc36b850-59a9-43bf-850e-3be6ae1fad03 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1405 microversion: 2.20 time: 0.162764 May 10 16:49:45.596708 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 319/606] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:45 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:46.614287 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-011c33e0-47ba-479c-9d48-129e889f3fae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:46.615072 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-011c33e0-47ba-479c-9d48-129e889f3fae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:46.621352 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-011c33e0-47ba-479c-9d48-129e889f3fae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:46.621802 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-011c33e0-47ba-479c-9d48-129e889f3fae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:46.622577 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-011c33e0-47ba-479c-9d48-129e889f3fae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:46.623044 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-011c33e0-47ba-479c-9d48-129e889f3fae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:46.750068 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-011c33e0-47ba-479c-9d48-129e889f3fae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:46.757770 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-011c33e0-47ba-479c-9d48-129e889f3fae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:46.759298 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-011c33e0-47ba-479c-9d48-129e889f3fae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:46.760399 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-011c33e0-47ba-479c-9d48-129e889f3fae tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1405 microversion: 2.20 time: 0.150805 May 10 16:49:46.760953 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 288/607] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:46 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:46.988426 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-9d0c24db-35b6-4666-a2f7-fdcd27e4dc56 req-72bfe5af-b08f-4441-8639-659a8d2f0263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be5fc929-1796-4c21-b41c-22850fb9939a", "tag": "043f55c8-7e1c-4a48-89b8-c52b9ab8066b"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:46.996801 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-9d0c24db-35b6-4666-a2f7-fdcd27e4dc56 req-72bfe5af-b08f-4441-8639-659a8d2f0263 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:46.997241 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-9d0c24db-35b6-4666-a2f7-fdcd27e4dc56 req-72bfe5af-b08f-4441-8639-659a8d2f0263 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:47.008144 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-9d0c24db-35b6-4666-a2f7-fdcd27e4dc56 req-72bfe5af-b08f-4441-8639-659a8d2f0263 service nova] Creating event network-changed:043f55c8-7e1c-4a48-89b8-c52b9ab8066b for instance be5fc929-1796-4c21-b41c-22850fb9939a on hv-cinder-84130 May 10 16:49:47.013013 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-9d0c24db-35b6-4666-a2f7-fdcd27e4dc56 req-72bfe5af-b08f-4441-8639-659a8d2f0263 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028202 May 10 16:49:47.013830 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 320/608] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:47.778680 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f9d0122a-a6c0-4ec8-b6c2-5ef49e3957a9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:47.779345 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-f9d0122a-a6c0-4ec8-b6c2-5ef49e3957a9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:47.786200 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f9d0122a-a6c0-4ec8-b6c2-5ef49e3957a9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:47.786650 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f9d0122a-a6c0-4ec8-b6c2-5ef49e3957a9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:47.787447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f9d0122a-a6c0-4ec8-b6c2-5ef49e3957a9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:47.787887 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f9d0122a-a6c0-4ec8-b6c2-5ef49e3957a9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:47.916691 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f9d0122a-a6c0-4ec8-b6c2-5ef49e3957a9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:47.925073 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f9d0122a-a6c0-4ec8-b6c2-5ef49e3957a9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:47.926843 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f9d0122a-a6c0-4ec8-b6c2-5ef49e3957a9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:47.927984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-f9d0122a-a6c0-4ec8-b6c2-5ef49e3957a9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1405 microversion: 2.20 time: 0.153169 May 10 16:49:47.928546 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 289/609] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:47 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:48.946889 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-da1ba4a2-1496-4229-8ea0-91b5152bf2d9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:48.947619 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-da1ba4a2-1496-4229-8ea0-91b5152bf2d9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:48.953594 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da1ba4a2-1496-4229-8ea0-91b5152bf2d9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:48.954104 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da1ba4a2-1496-4229-8ea0-91b5152bf2d9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:48.954875 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da1ba4a2-1496-4229-8ea0-91b5152bf2d9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:48.955345 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-da1ba4a2-1496-4229-8ea0-91b5152bf2d9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:49.085359 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-da1ba4a2-1496-4229-8ea0-91b5152bf2d9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:49.096070 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-da1ba4a2-1496-4229-8ea0-91b5152bf2d9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:49.097588 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-da1ba4a2-1496-4229-8ea0-91b5152bf2d9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:49.098697 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-da1ba4a2-1496-4229-8ea0-91b5152bf2d9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1405 microversion: 2.20 time: 0.156545 May 10 16:49:49.099372 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 321/610] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:48 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:49.440911 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-b32b06f8-ddeb-4bdf-b27c-1e7d6653e4e6 req-bb530197-f0ed-4dc9-bf39-7adf1a63c62d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97528e0b-5eec-4ed3-aa10-b4d56c9803ca", "name": "network-vif-plugged", "status": "completed", "tag": "f3864dfb-e0b5-4e42-879e-b9da171ec437"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:49.449368 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-b32b06f8-ddeb-4bdf-b27c-1e7d6653e4e6 req-bb530197-f0ed-4dc9-bf39-7adf1a63c62d service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:49.449957 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-b32b06f8-ddeb-4bdf-b27c-1e7d6653e4e6 req-bb530197-f0ed-4dc9-bf39-7adf1a63c62d service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:49.460955 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-b32b06f8-ddeb-4bdf-b27c-1e7d6653e4e6 req-bb530197-f0ed-4dc9-bf39-7adf1a63c62d service nova] Creating event network-vif-plugged:f3864dfb-e0b5-4e42-879e-b9da171ec437 for instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca on hv-cinder-84130 May 10 16:49:49.466006 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-b32b06f8-ddeb-4bdf-b27c-1e7d6653e4e6 req-bb530197-f0ed-4dc9-bf39-7adf1a63c62d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028755 May 10 16:49:49.466925 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 290/611] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:49:50.117265 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3e8bd792-bfb8-4a64-b0cd-b203282c642e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:50.117884 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3e8bd792-bfb8-4a64-b0cd-b203282c642e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:50.124805 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3e8bd792-bfb8-4a64-b0cd-b203282c642e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:50.125258 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3e8bd792-bfb8-4a64-b0cd-b203282c642e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:50.126092 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3e8bd792-bfb8-4a64-b0cd-b203282c642e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:50.126586 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3e8bd792-bfb8-4a64-b0cd-b203282c642e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:50.259160 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3e8bd792-bfb8-4a64-b0cd-b203282c642e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:50.267433 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3e8bd792-bfb8-4a64-b0cd-b203282c642e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:50.268940 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3e8bd792-bfb8-4a64-b0cd-b203282c642e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:50.270036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3e8bd792-bfb8-4a64-b0cd-b203282c642e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1405 microversion: 2.20 time: 0.156786 May 10 16:49:50.270631 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 322/612] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:50 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:51.289337 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-8254920a-0f5e-4787-b9e9-415979476e94 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:51.290073 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-8254920a-0f5e-4787-b9e9-415979476e94 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:51.296797 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8254920a-0f5e-4787-b9e9-415979476e94 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:51.297238 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8254920a-0f5e-4787-b9e9-415979476e94 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:51.298034 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8254920a-0f5e-4787-b9e9-415979476e94 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:51.298462 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8254920a-0f5e-4787-b9e9-415979476e94 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:51.434721 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-8254920a-0f5e-4787-b9e9-415979476e94 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:51.443023 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-8254920a-0f5e-4787-b9e9-415979476e94 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:51.444733 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-8254920a-0f5e-4787-b9e9-415979476e94 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:51.445832 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-8254920a-0f5e-4787-b9e9-415979476e94 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1405 microversion: 2.20 time: 0.161366 May 10 16:49:51.446386 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 291/613] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:51 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:52.464533 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-33be3d09-47e9-4a7f-99b3-cba7b6b78fa3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:52.465056 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-33be3d09-47e9-4a7f-99b3-cba7b6b78fa3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:52.471868 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-33be3d09-47e9-4a7f-99b3-cba7b6b78fa3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:52.472319 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-33be3d09-47e9-4a7f-99b3-cba7b6b78fa3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:52.473113 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-33be3d09-47e9-4a7f-99b3-cba7b6b78fa3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:52.473547 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-33be3d09-47e9-4a7f-99b3-cba7b6b78fa3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:52.596450 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-33be3d09-47e9-4a7f-99b3-cba7b6b78fa3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:52.604152 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-33be3d09-47e9-4a7f-99b3-cba7b6b78fa3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:52.605647 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-33be3d09-47e9-4a7f-99b3-cba7b6b78fa3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:49:52.606789 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-33be3d09-47e9-4a7f-99b3-cba7b6b78fa3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1597 microversion: 2.20 time: 0.146244 May 10 16:49:52.607372 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 323/614] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:49:52 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1597 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:49:52.624768 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-09726b04-a015-44e9-be8f-9326035428ac tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:49:52.625253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-09726b04-a015-44e9-be8f-9326035428ac tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:49:52.631051 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-09726b04-a015-44e9-be8f-9326035428ac tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:52.631496 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-09726b04-a015-44e9-be8f-9326035428ac tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:52.632250 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-09726b04-a015-44e9-be8f-9326035428ac tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:52.632679 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-09726b04-a015-44e9-be8f-9326035428ac tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:52.710872 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-09726b04-a015-44e9-be8f-9326035428ac tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090134 May 10 16:49:52.711495 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 292/615] 10.222.0.57 () {60 vars in 1315 bytes} [Tue May 10 16:49:52 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:49:53.666275 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-71dbed7e-15e3-425e-a856-74d0cbae5927 req-80cf07ff-c929-4e7e-bbd0-86e2d8802776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97528e0b-5eec-4ed3-aa10-b4d56c9803ca", "tag": "f3864dfb-e0b5-4e42-879e-b9da171ec437"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:49:53.675516 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-71dbed7e-15e3-425e-a856-74d0cbae5927 req-80cf07ff-c929-4e7e-bbd0-86e2d8802776 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:49:53.676081 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-71dbed7e-15e3-425e-a856-74d0cbae5927 req-80cf07ff-c929-4e7e-bbd0-86e2d8802776 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:49:53.687640 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-71dbed7e-15e3-425e-a856-74d0cbae5927 req-80cf07ff-c929-4e7e-bbd0-86e2d8802776 service nova] Creating event network-changed:f3864dfb-e0b5-4e42-879e-b9da171ec437 for instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca on hv-cinder-84130 May 10 16:49:53.692934 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-71dbed7e-15e3-425e-a856-74d0cbae5927 req-80cf07ff-c929-4e7e-bbd0-86e2d8802776 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031685 May 10 16:49:53.693727 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 324/616] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:50:17.424428 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-6246071c-02ca-48aa-b866-8b57c477a313 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:17.425021 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-6246071c-02ca-48aa-b866-8b57c477a313 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:17.431477 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6246071c-02ca-48aa-b866-8b57c477a313 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:17.431860 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6246071c-02ca-48aa-b866-8b57c477a313 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:17.432613 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6246071c-02ca-48aa-b866-8b57c477a313 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:17.433041 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6246071c-02ca-48aa-b866-8b57c477a313 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:17.616889 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.objects.instance [None req-6246071c-02ca-48aa-b866-8b57c477a313 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lazy-loading 'services' on Instance uuid be5fc929-1796-4c21-b41c-22850fb9939a {{(pid=128925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:50:17.727724 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-6246071c-02ca-48aa-b866-8b57c477a313 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "DELETE /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/os-volume_attachments/a900f3a4-102b-4864-8b1e-a0da3585e004" status: 202 len: 0 microversion: 2.1 time: 0.307389 May 10 16:50:17.728591 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 293/617] 10.222.0.57 () {58 vars in 1415 bytes} [Tue May 10 16:50:17 2022] DELETE /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/os-volume_attachments/a900f3a4-102b-4864-8b1e-a0da3585e004 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:50:17.738183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b7b6c379-d24b-4a47-8891-a8131db02990 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:17.740267 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b7b6c379-d24b-4a47-8891-a8131db02990 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:17.746566 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b7b6c379-d24b-4a47-8891-a8131db02990 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:17.747084 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b7b6c379-d24b-4a47-8891-a8131db02990 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:17.747873 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b7b6c379-d24b-4a47-8891-a8131db02990 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:17.748310 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b7b6c379-d24b-4a47-8891-a8131db02990 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:17.778780 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b7b6c379-d24b-4a47-8891-a8131db02990 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045583 May 10 16:50:17.779369 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 325/618] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 16:50:17 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:50:18.791216 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-9c4a94d5-140d-4464-b509-6f529dde45c5 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:18.792331 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-9c4a94d5-140d-4464-b509-6f529dde45c5 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:18.800091 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9c4a94d5-140d-4464-b509-6f529dde45c5 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:18.800521 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9c4a94d5-140d-4464-b509-6f529dde45c5 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:18.801313 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9c4a94d5-140d-4464-b509-6f529dde45c5 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:18.802147 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9c4a94d5-140d-4464-b509-6f529dde45c5 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:18.834648 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-9c4a94d5-140d-4464-b509-6f529dde45c5 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047804 May 10 16:50:18.835229 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 294/619] 10.222.0.57 () {58 vars in 1301 bytes} [Tue May 10 16:50:18 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 16:50:18.903953 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-852047ff-47ff-43b1-ad2a-589ea7fa0535 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:18.904458 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-852047ff-47ff-43b1-ad2a-589ea7fa0535 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:18.911494 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-852047ff-47ff-43b1-ad2a-589ea7fa0535 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:18.911969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-852047ff-47ff-43b1-ad2a-589ea7fa0535 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:18.912737 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-852047ff-47ff-43b1-ad2a-589ea7fa0535 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:18.913177 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-852047ff-47ff-43b1-ad2a-589ea7fa0535 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:18.937434 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-852047ff-47ff-43b1-ad2a-589ea7fa0535 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:50:19.008853 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-852047ff-47ff-43b1-ad2a-589ea7fa0535 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "DELETE /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 204 len: 0 microversion: 2.1 time: 0.108490 May 10 16:50:19.009336 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 326/620] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 16:50:18 2022] DELETE /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:50:19.018934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-2e5029a0-93ec-4652-88a8-473af855a912 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:19.019590 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-2e5029a0-93ec-4652-88a8-473af855a912 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:19.025945 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2e5029a0-93ec-4652-88a8-473af855a912 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:19.026388 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2e5029a0-93ec-4652-88a8-473af855a912 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:19.027200 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2e5029a0-93ec-4652-88a8-473af855a912 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:19.027630 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2e5029a0-93ec-4652-88a8-473af855a912 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:19.154618 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-2e5029a0-93ec-4652-88a8-473af855a912 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:19.161859 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-2e5029a0-93ec-4652-88a8-473af855a912 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1688 microversion: 2.1 time: 0.148208 May 10 16:50:19.162417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 295/621] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:19 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:20.179771 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-14fefbbb-7db4-42de-8cdf-6a897af77992 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:20.180474 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-14fefbbb-7db4-42de-8cdf-6a897af77992 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:20.186732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-14fefbbb-7db4-42de-8cdf-6a897af77992 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:20.187212 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-14fefbbb-7db4-42de-8cdf-6a897af77992 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:20.187970 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-14fefbbb-7db4-42de-8cdf-6a897af77992 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:20.188398 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-14fefbbb-7db4-42de-8cdf-6a897af77992 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:20.408379 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-14fefbbb-7db4-42de-8cdf-6a897af77992 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:20.416262 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-14fefbbb-7db4-42de-8cdf-6a897af77992 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1688 microversion: 2.1 time: 0.241353 May 10 16:50:20.416825 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 327/622] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:20 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1688 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:20.603176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 16:50:20.603733 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Tue May 10 16:50:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 16:50:21.433434 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-15a00095-d77c-4003-a19c-1340a2aa4544 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:21.434040 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-15a00095-d77c-4003-a19c-1340a2aa4544 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:21.440331 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-15a00095-d77c-4003-a19c-1340a2aa4544 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:21.440770 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-15a00095-d77c-4003-a19c-1340a2aa4544 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:21.441553 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-15a00095-d77c-4003-a19c-1340a2aa4544 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:21.441985 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-15a00095-d77c-4003-a19c-1340a2aa4544 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:21.569401 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-15a00095-d77c-4003-a19c-1340a2aa4544 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:21.576571 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-15a00095-d77c-4003-a19c-1340a2aa4544 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1688 microversion: 2.1 time: 0.147008 May 10 16:50:21.577127 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 296/623] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:21 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1688 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:21.725723 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 16:50:21.726260 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Tue May 10 16:50:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 16:50:22.592593 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9fbe24ba-9d00-47f5-9e51-375ad55d537b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:22.593121 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9fbe24ba-9d00-47f5-9e51-375ad55d537b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:22.600158 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9fbe24ba-9d00-47f5-9e51-375ad55d537b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:22.600612 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9fbe24ba-9d00-47f5-9e51-375ad55d537b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:22.601374 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9fbe24ba-9d00-47f5-9e51-375ad55d537b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:22.601807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9fbe24ba-9d00-47f5-9e51-375ad55d537b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:22.726137 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9fbe24ba-9d00-47f5-9e51-375ad55d537b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:22.733953 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9fbe24ba-9d00-47f5-9e51-375ad55d537b tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1688 microversion: 2.1 time: 0.145209 May 10 16:50:22.734522 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 328/624] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:22 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1688 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:23.751223 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-e328718c-d88b-45ac-b415-cb91cfae9e22 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:23.752612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-e328718c-d88b-45ac-b415-cb91cfae9e22 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:23.759848 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e328718c-d88b-45ac-b415-cb91cfae9e22 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:23.760547 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e328718c-d88b-45ac-b415-cb91cfae9e22 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:23.761308 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e328718c-d88b-45ac-b415-cb91cfae9e22 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:23.761927 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e328718c-d88b-45ac-b415-cb91cfae9e22 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:23.854776 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-e328718c-d88b-45ac-b415-cb91cfae9e22 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:23.863027 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-e328718c-d88b-45ac-b415-cb91cfae9e22 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 200 len: 1621 microversion: 2.1 time: 0.115476 May 10 16:50:23.864435 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 297/625] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:23 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 1621 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:23.917938 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-5cea1b71-1ce8-4bf1-b8b6-56989be1a90e req-c16ce419-6ee5-414d-8c3c-c2ee57c407c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5fc929-1796-4c21-b41c-22850fb9939a", "name": "network-vif-deleted", "tag": "043f55c8-7e1c-4a48-89b8-c52b9ab8066b"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:23.928503 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-5cea1b71-1ce8-4bf1-b8b6-56989be1a90e req-c16ce419-6ee5-414d-8c3c-c2ee57c407c1 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:23.933257 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-5cea1b71-1ce8-4bf1-b8b6-56989be1a90e req-c16ce419-6ee5-414d-8c3c-c2ee57c407c1 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:23.946121 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-5cea1b71-1ce8-4bf1-b8b6-56989be1a90e req-c16ce419-6ee5-414d-8c3c-c2ee57c407c1 service nova] Creating event network-vif-deleted:043f55c8-7e1c-4a48-89b8-c52b9ab8066b for instance be5fc929-1796-4c21-b41c-22850fb9939a on hv-cinder-84130 May 10 16:50:23.953016 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-5cea1b71-1ce8-4bf1-b8b6-56989be1a90e req-c16ce419-6ee5-414d-8c3c-c2ee57c407c1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039173 May 10 16:50:23.954203 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 329/626] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:50:24.879999 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b3a66c32-c5d0-4956-b7e5-18ab051c688a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:24.880534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-b3a66c32-c5d0-4956-b7e5-18ab051c688a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: be5fc929-1796-4c21-b41c-22850fb9939a] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:24.887495 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b3a66c32-c5d0-4956-b7e5-18ab051c688a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:24.887950 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b3a66c32-c5d0-4956-b7e5-18ab051c688a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:24.888731 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b3a66c32-c5d0-4956-b7e5-18ab051c688a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:24.889174 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b3a66c32-c5d0-4956-b7e5-18ab051c688a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:24.903133 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.wsgi [None req-b3a66c32-c5d0-4956-b7e5-18ab051c688a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] HTTP exception thrown: Instance be5fc929-1796-4c21-b41c-22850fb9939a could not be found. May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b3a66c32-c5d0-4956-b7e5-18ab051c688a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Request method failure captured: May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a HTTP/1.1 May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 0 May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepaUs505RQb-_itGhyItx6PoanxzUvVOQgaz_1Jo9glXWxcoGigpc5wkoPzDRwl-I4vB-wQ4_MxKAUesI6TqrOzBjlBZp69C5J2KLGz6296qMQ3sfqFgSCkXy2WF5NYGkfCnzgy0j3R-znN6Hy6TdvWyTAdluuxXRqfc6leOvHCnPYM May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: c0da2d582ad649208e7c4105faee8290 May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1303242210 May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:50:24.904763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:50:24.906505 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c0da2d582ad649208e7c4105faee8290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0da2d582ad649208e7c4105faee8290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0da2d582ad649208e7c4105faee8290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c0da2d582ad649208e7c4105faee8290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:50:24.906505 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1303242210 May 10 16:50:24.906505 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: c0da2d582ad649208e7c4105faee8290 May 10 16:50:24.906505 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1303242210 May 10 16:50:24.906505 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-ServerRescueNegativeTestJSON-1303242210-project May 10 16:50:24.906505 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:50:24.906505 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:50:24.906505 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: de5e76d5385f44fab03527751a478f1e May 10 16:50:24.906505 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1303242210-project May 10 16:50:24.906505 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: > May 10 16:50:24.906505 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Instance be5fc929-1796-4c21-b41c-22850fb9939a could not be found. May 10 16:50:24.906505 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'id': 'be5fc929-1796-4c21-b41c-22850fb9939a'} May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be5fc929-1796-4c21-b41c-22850fb9939a could not be found. May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:50:24.907471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:50:24.909002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:50:24.909002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:50:24.909002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:50:24.909002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:50:24.909002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:50:24.909002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:50:24.909002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:50:24.909002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be5fc929-1796-4c21-b41c-22850fb9939a could not be found. May 10 16:50:24.909002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:50:24.909002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:50:24.909002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:50:24.909002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:50:24.909002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:50:24.909002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:50:24.909002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:50:24.909002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:50:24.909002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be5fc929-1796-4c21-b41c-22850fb9939a could not be found. May 10 16:50:24.909002 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:50:24.911325 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b3a66c32-c5d0-4956-b7e5-18ab051c688a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Returning 404 to user: Instance be5fc929-1796-4c21-b41c-22850fb9939a could not be found. {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:50:24.911325 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b3a66c32-c5d0-4956-b7e5-18ab051c688a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a" status: 404 len: 111 microversion: 2.1 time: 0.030159 May 10 16:50:24.911325 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 298/627] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:24 2022] GET /compute/v2.1/servers/be5fc929-1796-4c21-b41c-22850fb9939a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:50:24.916658 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d183d78a-a0f5-48cd-b008-6a022cb9e043 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '.version_select at 0x7fdf19eaddc0>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:24.939154 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d183d78a-a0f5-48cd-b008-6a022cb9e043 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-96809514" status: 202 len: 0 microversion: 2.1 time: 0.026601 May 10 16:50:24.940365 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 330/628] 10.222.0.57 () {58 vars in 1214 bytes} [Tue May 10 16:50:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-96809514 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:50:27.774656 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-5554ac7e-23d0-4771-932e-3af652342193 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:27.775179 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-5554ac7e-23d0-4771-932e-3af652342193 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:27.781423 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5554ac7e-23d0-4771-932e-3af652342193 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:27.781871 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5554ac7e-23d0-4771-932e-3af652342193 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:27.782633 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5554ac7e-23d0-4771-932e-3af652342193 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:27.783165 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5554ac7e-23d0-4771-932e-3af652342193 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:27.808008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-5554ac7e-23d0-4771-932e-3af652342193 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Going to try to terminate instance {{(pid=128925) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:50:27.883925 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-5554ac7e-23d0-4771-932e-3af652342193 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 204 len: 0 microversion: 2.1 time: 0.112632 May 10 16:50:27.885130 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 299/629] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 16:50:27 2022] DELETE /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:50:27.896660 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6efbf3a0-c322-4d85-8648-6f8b0ede449a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:27.897394 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6efbf3a0-c322-4d85-8648-6f8b0ede449a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:27.904001 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6efbf3a0-c322-4d85-8648-6f8b0ede449a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:27.904447 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6efbf3a0-c322-4d85-8648-6f8b0ede449a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:27.905208 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6efbf3a0-c322-4d85-8648-6f8b0ede449a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:27.905644 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6efbf3a0-c322-4d85-8648-6f8b0ede449a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:28.031238 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6efbf3a0-c322-4d85-8648-6f8b0ede449a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:28.039055 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6efbf3a0-c322-4d85-8648-6f8b0ede449a tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1509 microversion: 2.1 time: 0.148522 May 10 16:50:28.039619 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 331/630] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:27 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:29.057971 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-d54f160f-ec4d-4119-95b7-ee777335bdbe tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:29.059049 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-d54f160f-ec4d-4119-95b7-ee777335bdbe tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:29.065374 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d54f160f-ec4d-4119-95b7-ee777335bdbe tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:29.065833 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d54f160f-ec4d-4119-95b7-ee777335bdbe tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:29.066613 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d54f160f-ec4d-4119-95b7-ee777335bdbe tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:29.067090 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d54f160f-ec4d-4119-95b7-ee777335bdbe tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:29.190679 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-d54f160f-ec4d-4119-95b7-ee777335bdbe tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:29.197953 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-d54f160f-ec4d-4119-95b7-ee777335bdbe tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1509 microversion: 2.1 time: 0.144218 May 10 16:50:29.198515 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 300/631] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:29 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1509 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:29.774836 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e1296f07-4c16-478e-a78b-2138e9b001bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:29.775345 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e1296f07-4c16-478e-a78b-2138e9b001bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:29.781321 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e1296f07-4c16-478e-a78b-2138e9b001bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:29.781761 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e1296f07-4c16-478e-a78b-2138e9b001bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:29.782518 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e1296f07-4c16-478e-a78b-2138e9b001bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:29.782950 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e1296f07-4c16-478e-a78b-2138e9b001bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:29.804904 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e1296f07-4c16-478e-a78b-2138e9b001bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca/ips" status: 200 len: 151 microversion: 2.20 time: 0.136416 May 10 16:50:29.805436 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 332/632] 10.222.0.57 () {60 vars in 1288 bytes} [Tue May 10 16:50:29 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca/ips => generated 151 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 16:50:30.214179 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-886e034d-6588-4ef5-8dd0-6bd1a2cb962d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:30.214731 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-886e034d-6588-4ef5-8dd0-6bd1a2cb962d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:30.221069 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-886e034d-6588-4ef5-8dd0-6bd1a2cb962d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:30.221516 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-886e034d-6588-4ef5-8dd0-6bd1a2cb962d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:30.222276 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-886e034d-6588-4ef5-8dd0-6bd1a2cb962d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:30.222715 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-886e034d-6588-4ef5-8dd0-6bd1a2cb962d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:30.357247 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-886e034d-6588-4ef5-8dd0-6bd1a2cb962d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:30.367105 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-886e034d-6588-4ef5-8dd0-6bd1a2cb962d tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 200 len: 1509 microversion: 2.1 time: 0.156427 May 10 16:50:30.367931 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 301/633] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:30 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:30.907402 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-50baf080-dfd7-4447-9492-0e7a786f41b6 req-84841287-c611-48b8-b7e8-8aa612e87fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21", "name": "network-vif-deleted", "tag": "c50b1483-8b5c-448b-bff0-552cf91cad7e"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:30.916705 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-50baf080-dfd7-4447-9492-0e7a786f41b6 req-84841287-c611-48b8-b7e8-8aa612e87fec service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:30.917501 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-50baf080-dfd7-4447-9492-0e7a786f41b6 req-84841287-c611-48b8-b7e8-8aa612e87fec service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:30.931555 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-50baf080-dfd7-4447-9492-0e7a786f41b6 req-84841287-c611-48b8-b7e8-8aa612e87fec service nova] Creating event network-vif-deleted:c50b1483-8b5c-448b-bff0-552cf91cad7e for instance e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 on hv-cinder-84130 May 10 16:50:30.936608 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-50baf080-dfd7-4447-9492-0e7a786f41b6 req-84841287-c611-48b8-b7e8-8aa612e87fec service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100865 May 10 16:50:30.937204 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 333/634] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:50:31.384200 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-132b2923-0e86-4fb0-86e9-9ac347e06106 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:31.385427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-132b2923-0e86-4fb0-86e9-9ac347e06106 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:31.392463 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-132b2923-0e86-4fb0-86e9-9ac347e06106 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:31.392912 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-132b2923-0e86-4fb0-86e9-9ac347e06106 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:31.393718 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-132b2923-0e86-4fb0-86e9-9ac347e06106 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:31.394207 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-132b2923-0e86-4fb0-86e9-9ac347e06106 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:31.408203 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.wsgi [None req-132b2923-0e86-4fb0-86e9-9ac347e06106 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] HTTP exception thrown: Instance e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 could not be found. May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-132b2923-0e86-4fb0-86e9-9ac347e06106 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Request method failure captured: May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 HTTP/1.1 May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 0 May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepaUs505RQb-_itGhyItx6PoanxzUvVOQgaz_1Jo9glXWxcoGigpc5wkoPzDRwl-I4vB-wQ4_MxKAUesI6TqrOzBjlBZp69C5J2KLGz6296qMQ3sfqFgSCkXy2WF5NYGkfCnzgy0j3R-znN6Hy6TdvWyTAdluuxXRqfc6leOvHCnPYM May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: c0da2d582ad649208e7c4105faee8290 May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1303242210 May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:50:31.409812 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:50:31.411277 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c0da2d582ad649208e7c4105faee8290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0da2d582ad649208e7c4105faee8290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0da2d582ad649208e7c4105faee8290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c0da2d582ad649208e7c4105faee8290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:50:31.411277 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1303242210 May 10 16:50:31.411277 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: c0da2d582ad649208e7c4105faee8290 May 10 16:50:31.411277 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1303242210 May 10 16:50:31.411277 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-ServerRescueNegativeTestJSON-1303242210-project May 10 16:50:31.411277 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:50:31.411277 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:50:31.411277 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: de5e76d5385f44fab03527751a478f1e May 10 16:50:31.411277 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1303242210-project May 10 16:50:31.411277 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: > May 10 16:50:31.411277 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Instance e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 could not be found. May 10 16:50:31.411277 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'id': 'e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21'} May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 could not be found. May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:50:31.412253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:50:31.413543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:50:31.413543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:50:31.413543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:50:31.413543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:50:31.413543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:50:31.413543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:50:31.413543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:50:31.413543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 could not be found. May 10 16:50:31.413543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:50:31.413543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:50:31.413543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:50:31.413543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:50:31.413543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:50:31.413543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:50:31.413543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:50:31.413543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:50:31.413543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 could not be found. May 10 16:50:31.413543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:50:31.414604 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-132b2923-0e86-4fb0-86e9-9ac347e06106 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Returning 404 to user: Instance e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 could not be found. {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:50:31.414604 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-132b2923-0e86-4fb0-86e9-9ac347e06106 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21" status: 404 len: 111 microversion: 2.1 time: 0.030998 May 10 16:50:31.414604 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 302/635] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:31 2022] GET /compute/v2.1/servers/e0f514cc-b0b7-4f6e-ac4f-d0e60da45b21 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:50:31.421985 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-27d4a60d-d0fa-4cc8-944a-358d7e2146f3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:31.423008 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-27d4a60d-d0fa-4cc8-944a-358d7e2146f3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:31.433985 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-27d4a60d-d0fa-4cc8-944a-358d7e2146f3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:31.434696 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-27d4a60d-d0fa-4cc8-944a-358d7e2146f3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:31.435621 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-27d4a60d-d0fa-4cc8-944a-358d7e2146f3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:31.436068 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-27d4a60d-d0fa-4cc8-944a-358d7e2146f3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:31.460644 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-27d4a60d-d0fa-4cc8-944a-358d7e2146f3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:50:31.532906 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-27d4a60d-d0fa-4cc8-944a-358d7e2146f3 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "DELETE /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 204 len: 0 microversion: 2.1 time: 0.115854 May 10 16:50:31.533487 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 334/636] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 16:50:31 2022] DELETE /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 16:50:31.541559 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-0c704cb2-d4ac-4318-b5fe-31dcc674bf92 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:31.542172 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-0c704cb2-d4ac-4318-b5fe-31dcc674bf92 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:31.548089 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0c704cb2-d4ac-4318-b5fe-31dcc674bf92 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:31.548676 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0c704cb2-d4ac-4318-b5fe-31dcc674bf92 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:31.549989 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0c704cb2-d4ac-4318-b5fe-31dcc674bf92 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:31.550779 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-0c704cb2-d4ac-4318-b5fe-31dcc674bf92 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:31.689526 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-48eabae5-9165-495b-95f4-a43a1cbba99d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:31.690146 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-48eabae5-9165-495b-95f4-a43a1cbba99d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:31.691758 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-0c704cb2-d4ac-4318-b5fe-31dcc674bf92 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:31.696318 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-48eabae5-9165-495b-95f4-a43a1cbba99d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:31.696769 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-48eabae5-9165-495b-95f4-a43a1cbba99d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:31.697539 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-48eabae5-9165-495b-95f4-a43a1cbba99d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:31.697972 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-48eabae5-9165-495b-95f4-a43a1cbba99d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:31.701381 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-0c704cb2-d4ac-4318-b5fe-31dcc674bf92 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.163652 May 10 16:50:31.701954 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 303/637] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:31 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:31.720773 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-48eabae5-9165-495b-95f4-a43a1cbba99d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lazy-loading 'flavor' on Instance uuid 97528e0b-5eec-4ed3-aa10-b4d56c9803ca {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:50:31.994895 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-48eabae5-9165-495b-95f4-a43a1cbba99d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "POST /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca/action" status: 202 len: 0 microversion: 2.20 time: 0.309475 May 10 16:50:31.995562 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 335/638] 10.222.0.57 () {62 vars in 1318 bytes} [Tue May 10 16:50:31 2022] POST /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 10 16:50:32.003758 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-45161d59-c9ab-4dd5-93f6-9a17da950d07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:32.004816 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-45161d59-c9ab-4dd5-93f6-9a17da950d07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:32.011553 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-45161d59-c9ab-4dd5-93f6-9a17da950d07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:32.011998 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-45161d59-c9ab-4dd5-93f6-9a17da950d07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:32.012771 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-45161d59-c9ab-4dd5-93f6-9a17da950d07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:32.013207 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-45161d59-c9ab-4dd5-93f6-9a17da950d07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:32.144151 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-45161d59-c9ab-4dd5-93f6-9a17da950d07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:32.152956 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-45161d59-c9ab-4dd5-93f6-9a17da950d07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:32.154393 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-45161d59-c9ab-4dd5-93f6-9a17da950d07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:32.155570 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-45161d59-c9ab-4dd5-93f6-9a17da950d07 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1721 microversion: 2.20 time: 0.155787 May 10 16:50:32.156111 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 304/639] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:31 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:32.720596 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-bda58f0d-1a20-43f7-abc8-a17295b44705 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:32.721284 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-bda58f0d-1a20-43f7-abc8-a17295b44705 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:32.728043 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bda58f0d-1a20-43f7-abc8-a17295b44705 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:32.728490 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bda58f0d-1a20-43f7-abc8-a17295b44705 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:32.729253 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bda58f0d-1a20-43f7-abc8-a17295b44705 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:32.729685 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-bda58f0d-1a20-43f7-abc8-a17295b44705 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:32.857744 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-bda58f0d-1a20-43f7-abc8-a17295b44705 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:32.865623 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-bda58f0d-1a20-43f7-abc8-a17295b44705 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.149188 May 10 16:50:32.866206 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 336/640] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:32 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:33.174949 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-a9ecda1c-eb82-4434-8d1e-f2c0544427dc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:33.175729 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-a9ecda1c-eb82-4434-8d1e-f2c0544427dc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:33.182563 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a9ecda1c-eb82-4434-8d1e-f2c0544427dc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:33.183045 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a9ecda1c-eb82-4434-8d1e-f2c0544427dc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:33.183809 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a9ecda1c-eb82-4434-8d1e-f2c0544427dc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:33.184245 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a9ecda1c-eb82-4434-8d1e-f2c0544427dc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:33.309763 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-a9ecda1c-eb82-4434-8d1e-f2c0544427dc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:33.317453 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-a9ecda1c-eb82-4434-8d1e-f2c0544427dc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:33.318972 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-a9ecda1c-eb82-4434-8d1e-f2c0544427dc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:33.320137 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-a9ecda1c-eb82-4434-8d1e-f2c0544427dc tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1721 microversion: 2.20 time: 0.149178 May 10 16:50:33.321833 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 305/641] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:33 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:50:33.882194 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-80d1b051-6992-4ebd-8243-78998a964e5f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:33.882732 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-80d1b051-6992-4ebd-8243-78998a964e5f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:33.889414 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-80d1b051-6992-4ebd-8243-78998a964e5f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:33.889857 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-80d1b051-6992-4ebd-8243-78998a964e5f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:33.890652 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-80d1b051-6992-4ebd-8243-78998a964e5f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:33.891211 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-80d1b051-6992-4ebd-8243-78998a964e5f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:34.024268 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-80d1b051-6992-4ebd-8243-78998a964e5f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:34.031424 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-80d1b051-6992-4ebd-8243-78998a964e5f tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1523 microversion: 2.1 time: 0.153695 May 10 16:50:34.031997 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 337/642] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:33 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:34.339664 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-104924b6-78fe-4b40-9962-342e872ff304 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:34.340489 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-104924b6-78fe-4b40-9962-342e872ff304 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:34.346760 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-104924b6-78fe-4b40-9962-342e872ff304 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:34.347309 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-104924b6-78fe-4b40-9962-342e872ff304 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:34.348671 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-104924b6-78fe-4b40-9962-342e872ff304 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:34.349176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-104924b6-78fe-4b40-9962-342e872ff304 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:34.518139 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-104924b6-78fe-4b40-9962-342e872ff304 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:34.526250 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-104924b6-78fe-4b40-9962-342e872ff304 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:34.527765 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-104924b6-78fe-4b40-9962-342e872ff304 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:34.528942 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-104924b6-78fe-4b40-9962-342e872ff304 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1721 microversion: 2.20 time: 0.193132 May 10 16:50:34.529503 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 306/643] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:34 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:34.638839 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-52c144e6-e898-4954-a071-f4502e5c92de req-2296f664-a306-46d9-b642-a65f84bb13d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7072f21c-b362-4442-9b4e-e7ad82c6ab7d", "name": "network-vif-deleted", "tag": "6c9ff718-8934-43ae-8084-2ab8d87294af"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:34.647414 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-52c144e6-e898-4954-a071-f4502e5c92de req-2296f664-a306-46d9-b642-a65f84bb13d2 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:34.647862 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-52c144e6-e898-4954-a071-f4502e5c92de req-2296f664-a306-46d9-b642-a65f84bb13d2 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:34.658502 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-52c144e6-e898-4954-a071-f4502e5c92de req-2296f664-a306-46d9-b642-a65f84bb13d2 service nova] Creating event network-vif-deleted:6c9ff718-8934-43ae-8084-2ab8d87294af for instance 7072f21c-b362-4442-9b4e-e7ad82c6ab7d on hv-cinder-84130 May 10 16:50:34.663779 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-52c144e6-e898-4954-a071-f4502e5c92de req-2296f664-a306-46d9-b642-a65f84bb13d2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028730 May 10 16:50:34.664368 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 338/644] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:50:35.049595 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-ee2502d8-c1a2-45e9-bd5f-a038c9998b75 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:35.050200 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-ee2502d8-c1a2-45e9-bd5f-a038c9998b75 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:35.056588 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ee2502d8-c1a2-45e9-bd5f-a038c9998b75 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.057037 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ee2502d8-c1a2-45e9-bd5f-a038c9998b75 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:35.057799 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ee2502d8-c1a2-45e9-bd5f-a038c9998b75 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.058234 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ee2502d8-c1a2-45e9-bd5f-a038c9998b75 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:35.090326 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ee2502d8-c1a2-45e9-bd5f-a038c9998b75 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.090938 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ee2502d8-c1a2-45e9-bd5f-a038c9998b75 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:35.091427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.objects.instance [None req-ee2502d8-c1a2-45e9-bd5f-a038c9998b75 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lazy-loading 'fault' on Instance uuid 7072f21c-b362-4442-9b4e-e7ad82c6ab7d {{(pid=128925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:50:35.134801 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ee2502d8-c1a2-45e9-bd5f-a038c9998b75 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de5e76d5385f44fab03527751a478f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0da2d582ad649208e7c4105faee8290', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:35.142492 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-ee2502d8-c1a2-45e9-bd5f-a038c9998b75 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 200 len: 1312 microversion: 2.1 time: 0.096814 May 10 16:50:35.143079 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 307/645] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:35 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:35.549204 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4d3ff039-cf9b-4c11-9683-e19cb91b83bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:35.549896 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4d3ff039-cf9b-4c11-9683-e19cb91b83bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:35.556694 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4d3ff039-cf9b-4c11-9683-e19cb91b83bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.557144 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4d3ff039-cf9b-4c11-9683-e19cb91b83bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:35.557905 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4d3ff039-cf9b-4c11-9683-e19cb91b83bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.558337 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4d3ff039-cf9b-4c11-9683-e19cb91b83bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:35.691329 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4d3ff039-cf9b-4c11-9683-e19cb91b83bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:35.698907 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4d3ff039-cf9b-4c11-9683-e19cb91b83bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:35.700456 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4d3ff039-cf9b-4c11-9683-e19cb91b83bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:35.701601 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4d3ff039-cf9b-4c11-9683-e19cb91b83bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1721 microversion: 2.20 time: 0.157110 May 10 16:50:35.702150 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 339/646] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:35 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:50:35.755122 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-4d4530a0-d6a7-4de0-a4dc-1e4dc588ed3c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:35.755667 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-4d4530a0-d6a7-4de0-a4dc-1e4dc588ed3c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:35.761984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4d4530a0-d6a7-4de0-a4dc-1e4dc588ed3c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.762429 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4d4530a0-d6a7-4de0-a4dc-1e4dc588ed3c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:35.763212 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4d4530a0-d6a7-4de0-a4dc-1e4dc588ed3c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.763646 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4d4530a0-d6a7-4de0-a4dc-1e4dc588ed3c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:35.789843 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-4d4530a0-d6a7-4de0-a4dc-1e4dc588ed3c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Going to try to terminate instance {{(pid=128925) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:50:35.858437 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-33175ee7-58fe-4719-88e3-05956305c710 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:35.859023 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-33175ee7-58fe-4719-88e3-05956305c710 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:35.862900 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-4d4530a0-d6a7-4de0-a4dc-1e4dc588ed3c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "DELETE /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 204 len: 0 microversion: 2.1 time: 0.111223 May 10 16:50:35.865843 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-33175ee7-58fe-4719-88e3-05956305c710 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.866304 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-33175ee7-58fe-4719-88e3-05956305c710 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:35.867300 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 308/647] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 16:50:35 2022] DELETE /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:50:35.867713 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-33175ee7-58fe-4719-88e3-05956305c710 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.868133 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-33175ee7-58fe-4719-88e3-05956305c710 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:35.873995 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-33b7cd33-ff84-42eb-a8ef-5ed8c3ad507b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:35.874690 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-33b7cd33-ff84-42eb-a8ef-5ed8c3ad507b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:35.880603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-33b7cd33-ff84-42eb-a8ef-5ed8c3ad507b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.881052 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-33b7cd33-ff84-42eb-a8ef-5ed8c3ad507b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:35.881818 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-33b7cd33-ff84-42eb-a8ef-5ed8c3ad507b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.882248 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-33b7cd33-ff84-42eb-a8ef-5ed8c3ad507b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:35.896729 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.objects.instance [None req-33175ee7-58fe-4719-88e3-05956305c710 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lazy-loading 'flavor' on Instance uuid 25b14b06-9428-41e6-ae67-68b253218e24 {{(pid=128924) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:50:35.969815 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-33175ee7-58fe-4719-88e3-05956305c710 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "POST /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24/action" status: 202 len: 0 microversion: 2.1 time: 0.115412 May 10 16:50:35.974036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 340/648] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 16:50:35 2022] POST /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:50:35.979475 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-33ac7f32-e2a4-41df-900e-489728606816 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:35.980264 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-33ac7f32-e2a4-41df-900e-489728606816 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:35.986227 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-33ac7f32-e2a4-41df-900e-489728606816 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.986708 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-33ac7f32-e2a4-41df-900e-489728606816 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:35.987514 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-33ac7f32-e2a4-41df-900e-489728606816 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:35.987952 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-33ac7f32-e2a4-41df-900e-489728606816 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:36.020334 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-33b7cd33-ff84-42eb-a8ef-5ed8c3ad507b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:36.027797 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-33b7cd33-ff84-42eb-a8ef-5ed8c3ad507b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1576 microversion: 2.1 time: 0.158925 May 10 16:50:36.028456 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 309/649] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:35 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:36.117877 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-33ac7f32-e2a4-41df-900e-489728606816 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:36.125312 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-33ac7f32-e2a4-41df-900e-489728606816 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1569 microversion: 2.1 time: 0.149953 May 10 16:50:36.125885 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 341/650] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:35 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:36.160061 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1d4a738e-0992-4964-b6a7-57fe1756e706 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:36.161297 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-1d4a738e-0992-4964-b6a7-57fe1756e706 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] [instance: 7072f21c-b362-4442-9b4e-e7ad82c6ab7d] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:36.167175 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1d4a738e-0992-4964-b6a7-57fe1756e706 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:36.167621 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1d4a738e-0992-4964-b6a7-57fe1756e706 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:36.168374 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1d4a738e-0992-4964-b6a7-57fe1756e706 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:36.168802 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1d4a738e-0992-4964-b6a7-57fe1756e706 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:36.181717 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.wsgi [None req-1d4a738e-0992-4964-b6a7-57fe1756e706 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] HTTP exception thrown: Instance 7072f21c-b362-4442-9b4e-e7ad82c6ab7d could not be found. May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1d4a738e-0992-4964-b6a7-57fe1756e706 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Request method failure captured: May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d HTTP/1.1 May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 0 May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepaUs505RQb-_itGhyItx6PoanxzUvVOQgaz_1Jo9glXWxcoGigpc5wkoPzDRwl-I4vB-wQ4_MxKAUesI6TqrOzBjlBZp69C5J2KLGz6296qMQ3sfqFgSCkXy2WF5NYGkfCnzgy0j3R-znN6Hy6TdvWyTAdluuxXRqfc6leOvHCnPYM May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: c0da2d582ad649208e7c4105faee8290 May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1303242210 May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:50:36.183329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:50:36.184892 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c0da2d582ad649208e7c4105faee8290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0da2d582ad649208e7c4105faee8290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c0da2d582ad649208e7c4105faee8290"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c0da2d582ad649208e7c4105faee8290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:50:36.184892 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1303242210 May 10 16:50:36.184892 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: c0da2d582ad649208e7c4105faee8290 May 10 16:50:36.184892 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1303242210 May 10 16:50:36.184892 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-ServerRescueNegativeTestJSON-1303242210-project May 10 16:50:36.184892 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:50:36.184892 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:50:36.184892 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: de5e76d5385f44fab03527751a478f1e May 10 16:50:36.184892 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1303242210-project May 10 16:50:36.184892 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: > May 10 16:50:36.184892 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Instance 7072f21c-b362-4442-9b4e-e7ad82c6ab7d could not be found. May 10 16:50:36.184892 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'id': '7072f21c-b362-4442-9b4e-e7ad82c6ab7d'} May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7072f21c-b362-4442-9b4e-e7ad82c6ab7d could not be found. May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:50:36.185790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:50:36.187255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:50:36.187255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:50:36.187255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:50:36.187255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:50:36.187255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:50:36.187255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:50:36.187255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:50:36.187255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7072f21c-b362-4442-9b4e-e7ad82c6ab7d could not be found. May 10 16:50:36.187255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:50:36.187255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:50:36.187255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:50:36.187255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:50:36.187255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:50:36.187255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:50:36.187255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:50:36.187255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:50:36.187255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7072f21c-b362-4442-9b4e-e7ad82c6ab7d could not be found. May 10 16:50:36.187255 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:50:36.188574 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1d4a738e-0992-4964-b6a7-57fe1756e706 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] Returning 404 to user: Instance 7072f21c-b362-4442-9b4e-e7ad82c6ab7d could not be found. {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:50:36.188574 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-1d4a738e-0992-4964-b6a7-57fe1756e706 tempest-ServerRescueNegativeTestJSON-1303242210 tempest-ServerRescueNegativeTestJSON-1303242210-project] 10.222.0.57 "GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d" status: 404 len: 111 microversion: 2.1 time: 0.028478 May 10 16:50:36.188574 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 310/651] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:36 2022] GET /compute/v2.1/servers/7072f21c-b362-4442-9b4e-e7ad82c6ab7d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:50:36.719978 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b8445521-7d7d-4ee4-8cbf-757ff6d1c040 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:36.720675 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b8445521-7d7d-4ee4-8cbf-757ff6d1c040 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:36.726970 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b8445521-7d7d-4ee4-8cbf-757ff6d1c040 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:36.727446 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b8445521-7d7d-4ee4-8cbf-757ff6d1c040 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:36.728219 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b8445521-7d7d-4ee4-8cbf-757ff6d1c040 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:36.728657 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b8445521-7d7d-4ee4-8cbf-757ff6d1c040 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:37.009642 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b8445521-7d7d-4ee4-8cbf-757ff6d1c040 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:37.017374 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b8445521-7d7d-4ee4-8cbf-757ff6d1c040 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:37.018915 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b8445521-7d7d-4ee4-8cbf-757ff6d1c040 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:37.020129 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b8445521-7d7d-4ee4-8cbf-757ff6d1c040 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1721 microversion: 2.20 time: 0.304089 May 10 16:50:37.020692 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 342/652] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:36 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1721 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:37.045891 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-fa7f68f4-4564-48b2-94b3-cb80513bf5ae tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:37.046506 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-fa7f68f4-4564-48b2-94b3-cb80513bf5ae tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:37.055360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fa7f68f4-4564-48b2-94b3-cb80513bf5ae tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:37.055950 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fa7f68f4-4564-48b2-94b3-cb80513bf5ae tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:37.056822 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fa7f68f4-4564-48b2-94b3-cb80513bf5ae tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:37.057328 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-fa7f68f4-4564-48b2-94b3-cb80513bf5ae tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:37.141645 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0acf312c-e5b7-4e04-9a7b-4c45025a90c3 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:37.142258 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0acf312c-e5b7-4e04-9a7b-4c45025a90c3 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:37.148152 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0acf312c-e5b7-4e04-9a7b-4c45025a90c3 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:37.148607 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0acf312c-e5b7-4e04-9a7b-4c45025a90c3 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:37.149379 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0acf312c-e5b7-4e04-9a7b-4c45025a90c3 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:37.149823 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0acf312c-e5b7-4e04-9a7b-4c45025a90c3 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:37.395464 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-fa7f68f4-4564-48b2-94b3-cb80513bf5ae tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:37.402914 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-fa7f68f4-4564-48b2-94b3-cb80513bf5ae tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1576 microversion: 2.1 time: 0.361145 May 10 16:50:37.403707 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 311/653] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:37 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1576 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:37.418762 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0acf312c-e5b7-4e04-9a7b-4c45025a90c3 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:37.427167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0acf312c-e5b7-4e04-9a7b-4c45025a90c3 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1569 microversion: 2.1 time: 0.288421 May 10 16:50:37.436635 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 343/654] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:37 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1569 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:38.040848 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b942d2b6-66dc-46fb-b992-02c8d618bbaf tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:38.041641 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-b942d2b6-66dc-46fb-b992-02c8d618bbaf tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:38.048256 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b942d2b6-66dc-46fb-b992-02c8d618bbaf tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:38.048848 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b942d2b6-66dc-46fb-b992-02c8d618bbaf tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:38.049640 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b942d2b6-66dc-46fb-b992-02c8d618bbaf tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:38.050089 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b942d2b6-66dc-46fb-b992-02c8d618bbaf tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:38.382792 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b942d2b6-66dc-46fb-b992-02c8d618bbaf tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:38.390487 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b942d2b6-66dc-46fb-b992-02c8d618bbaf tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:38.391995 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b942d2b6-66dc-46fb-b992-02c8d618bbaf tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:38.393139 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b942d2b6-66dc-46fb-b992-02c8d618bbaf tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1721 microversion: 2.20 time: 0.356567 May 10 16:50:38.403501 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 312/655] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:38 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1721 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:38.420222 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-808dca1c-96b7-4a67-bd3a-31583878c887 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:38.420831 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-808dca1c-96b7-4a67-bd3a-31583878c887 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:38.427531 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-808dca1c-96b7-4a67-bd3a-31583878c887 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:38.427975 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-808dca1c-96b7-4a67-bd3a-31583878c887 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:38.428740 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-808dca1c-96b7-4a67-bd3a-31583878c887 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:38.429169 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-808dca1c-96b7-4a67-bd3a-31583878c887 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:38.446152 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-8011c839-38fc-4cfc-89d5-d27b7bb81a4d tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:38.446921 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-8011c839-38fc-4cfc-89d5-d27b7bb81a4d tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:38.454817 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8011c839-38fc-4cfc-89d5-d27b7bb81a4d tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:38.456234 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8011c839-38fc-4cfc-89d5-d27b7bb81a4d tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:38.457130 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8011c839-38fc-4cfc-89d5-d27b7bb81a4d tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:38.458144 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8011c839-38fc-4cfc-89d5-d27b7bb81a4d tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:39.017387 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-808dca1c-96b7-4a67-bd3a-31583878c887 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:39.025451 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-808dca1c-96b7-4a67-bd3a-31583878c887 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1576 microversion: 2.1 time: 0.609174 May 10 16:50:39.026012 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 344/656] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:38 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1576 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:39.039129 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-8011c839-38fc-4cfc-89d5-d27b7bb81a4d tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:39.046440 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-8011c839-38fc-4cfc-89d5-d27b7bb81a4d tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1569 microversion: 2.1 time: 0.606577 May 10 16:50:39.047019 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 313/657] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:38 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1569 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:39.416108 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0d2a6e76-d1cb-4b9f-825b-c56b128b50e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:39.417339 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0d2a6e76-d1cb-4b9f-825b-c56b128b50e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:39.428094 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0d2a6e76-d1cb-4b9f-825b-c56b128b50e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:39.428708 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0d2a6e76-d1cb-4b9f-825b-c56b128b50e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:39.432693 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-627c6033-7cef-4052-bc78-615391ca4163 req-00f3d825-81cc-4aeb-83bf-3aa4941d1ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "256c0577-62c0-4b3f-bc59-3171e7928b0c", "name": "network-vif-deleted", "tag": "7f137a16-3c79-4550-b56b-4ded57073eee"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:39.435059 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0d2a6e76-d1cb-4b9f-825b-c56b128b50e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:39.435522 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0d2a6e76-d1cb-4b9f-825b-c56b128b50e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:39.442940 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-627c6033-7cef-4052-bc78-615391ca4163 req-00f3d825-81cc-4aeb-83bf-3aa4941d1ba2 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:39.443532 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-627c6033-7cef-4052-bc78-615391ca4163 req-00f3d825-81cc-4aeb-83bf-3aa4941d1ba2 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:39.462050 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-627c6033-7cef-4052-bc78-615391ca4163 req-00f3d825-81cc-4aeb-83bf-3aa4941d1ba2 service nova] Creating event network-vif-deleted:7f137a16-3c79-4550-b56b-4ded57073eee for instance 256c0577-62c0-4b3f-bc59-3171e7928b0c on hv-cinder-84130 May 10 16:50:39.471730 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-627c6033-7cef-4052-bc78-615391ca4163 req-00f3d825-81cc-4aeb-83bf-3aa4941d1ba2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042666 May 10 16:50:39.478368 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 314/658] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:50:39.678091 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0d2a6e76-d1cb-4b9f-825b-c56b128b50e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:39.688719 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0d2a6e76-d1cb-4b9f-825b-c56b128b50e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:39.691953 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0d2a6e76-d1cb-4b9f-825b-c56b128b50e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:39.693260 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0d2a6e76-d1cb-4b9f-825b-c56b128b50e9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1721 microversion: 2.20 time: 0.286812 May 10 16:50:39.693904 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 345/659] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:39 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:40.042498 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-2ab040b5-0e2a-47e9-88a2-386511e2bcb6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:40.043369 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-2ab040b5-0e2a-47e9-88a2-386511e2bcb6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:40.052827 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2ab040b5-0e2a-47e9-88a2-386511e2bcb6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:40.053946 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2ab040b5-0e2a-47e9-88a2-386511e2bcb6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:40.054922 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2ab040b5-0e2a-47e9-88a2-386511e2bcb6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:40.055546 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2ab040b5-0e2a-47e9-88a2-386511e2bcb6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:40.064905 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6c70cbf6-b561-49df-bac3-1b5c8e655596 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:40.065663 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6c70cbf6-b561-49df-bac3-1b5c8e655596 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:40.078375 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6c70cbf6-b561-49df-bac3-1b5c8e655596 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:40.079718 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6c70cbf6-b561-49df-bac3-1b5c8e655596 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:40.081850 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6c70cbf6-b561-49df-bac3-1b5c8e655596 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:40.083085 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6c70cbf6-b561-49df-bac3-1b5c8e655596 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:40.113157 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2ab040b5-0e2a-47e9-88a2-386511e2bcb6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:40.114546 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2ab040b5-0e2a-47e9-88a2-386511e2bcb6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:40.115214 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.objects.instance [None req-2ab040b5-0e2a-47e9-88a2-386511e2bcb6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lazy-loading 'fault' on Instance uuid 256c0577-62c0-4b3f-bc59-3171e7928b0c {{(pid=128925) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 16:50:40.208808 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-2ab040b5-0e2a-47e9-88a2-386511e2bcb6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:40.220067 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-2ab040b5-0e2a-47e9-88a2-386511e2bcb6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 200 len: 1229 microversion: 2.1 time: 0.181802 May 10 16:50:40.221209 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 315/660] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:40 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 1229 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:40.302632 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6c70cbf6-b561-49df-bac3-1b5c8e655596 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:40.311065 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6c70cbf6-b561-49df-bac3-1b5c8e655596 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1569 microversion: 2.1 time: 0.251250 May 10 16:50:40.312362 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 346/661] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:40 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:40.713347 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-8b8298cc-1ffa-4822-af22-40f94f59b995 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:40.713926 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-8b8298cc-1ffa-4822-af22-40f94f59b995 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:40.720311 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8b8298cc-1ffa-4822-af22-40f94f59b995 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:40.720768 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8b8298cc-1ffa-4822-af22-40f94f59b995 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:40.721556 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8b8298cc-1ffa-4822-af22-40f94f59b995 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:40.721993 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-8b8298cc-1ffa-4822-af22-40f94f59b995 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:40.855371 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-8b8298cc-1ffa-4822-af22-40f94f59b995 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:40.863114 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-8b8298cc-1ffa-4822-af22-40f94f59b995 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:40.864665 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-8b8298cc-1ffa-4822-af22-40f94f59b995 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:40.865826 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-8b8298cc-1ffa-4822-af22-40f94f59b995 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1721 microversion: 2.20 time: 0.156438 May 10 16:50:40.866383 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 316/662] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:40 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:41.237617 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b35addb4-9741-4e99-a9ef-79708d5071b1 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:41.239957 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b35addb4-9741-4e99-a9ef-79708d5071b1 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: 256c0577-62c0-4b3f-bc59-3171e7928b0c] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:41.247868 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b35addb4-9741-4e99-a9ef-79708d5071b1 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:41.248534 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b35addb4-9741-4e99-a9ef-79708d5071b1 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:41.249322 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b35addb4-9741-4e99-a9ef-79708d5071b1 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:41.250149 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b35addb4-9741-4e99-a9ef-79708d5071b1 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:41.267203 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-b35addb4-9741-4e99-a9ef-79708d5071b1 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] HTTP exception thrown: Instance 256c0577-62c0-4b3f-bc59-3171e7928b0c could not be found. May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b35addb4-9741-4e99-a9ef-79708d5071b1 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Request method failure captured: May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: request: GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c HTTP/1.1 May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept: application/json May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Connection: close May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Host: 10.222.0.57 May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABiepb0kvni70ZB3SPPTyEHgteBG2f5ffmaWQUF6Cnz93Xr7wim9SvE0fhw3pRXXLdLVBtjiXtJ5vlmPTcORb8kd81NJjliu9KutDNQ3jh48v7nYDVSpXTjWGSGf8_rrVZ0A0txINCdpjAdt972zHzH54e24NvkZUSKFIIHTUkCGbW-mSc May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Id: 84465c37c1474aa68266191586ba2953 May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-TestVolumeBootPattern-471976404 May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 10 16:50:41.269255 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 10 16:50:41.270789 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/84465c37c1474aa68266191586ba2953"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/84465c37c1474aa68266191586ba2953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/84465c37c1474aa68266191586ba2953"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_84465c37c1474aa68266191586ba2953"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:50:41.270789 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-TestVolumeBootPattern-471976404 May 10 16:50:41.270789 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 84465c37c1474aa68266191586ba2953 May 10 16:50:41.270789 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-TestVolumeBootPattern-471976404 May 10 16:50:41.270789 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User: tempest-TestVolumeBootPattern-471976404-project May 10 16:50:41.270789 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 10 16:50:41.270789 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 10 16:50:41.270789 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Id: 1bc2420288964c389f6529d9ede09bd4 May 10 16:50:41.270789 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-TestVolumeBootPattern-471976404-project May 10 16:50:41.270789 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: method: > May 10 16:50:41.270789 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: exception: Instance 256c0577-62c0-4b3f-bc59-3171e7928b0c could not be found. May 10 16:50:41.270789 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: action_args: {'id': '256c0577-62c0-4b3f-bc59-3171e7928b0c'} May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 256c0577-62c0-4b3f-bc59-3171e7928b0c could not be found. May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:50:41.271688 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:50:41.273243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:50:41.273243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:50:41.273243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:50:41.273243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:50:41.273243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:50:41.273243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:50:41.273243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:50:41.273243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 256c0577-62c0-4b3f-bc59-3171e7928b0c could not be found. May 10 16:50:41.273243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:50:41.273243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:50:41.273243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:50:41.273243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:50:41.273243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:50:41.273243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:50:41.273243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:50:41.273243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:50:41.273243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 256c0577-62c0-4b3f-bc59-3171e7928b0c could not be found. May 10 16:50:41.273243 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:50:41.274520 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b35addb4-9741-4e99-a9ef-79708d5071b1 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Returning 404 to user: Instance 256c0577-62c0-4b3f-bc59-3171e7928b0c could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:50:41.274520 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b35addb4-9741-4e99-a9ef-79708d5071b1 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c" status: 404 len: 111 microversion: 2.1 time: 0.037913 May 10 16:50:41.274520 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 347/663] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:41 2022] GET /compute/v2.1/servers/256c0577-62c0-4b3f-bc59-3171e7928b0c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 16:50:41.329166 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-a18dd32d-dcce-4c88-ac9e-f3198aa8de62 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:41.329969 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-a18dd32d-dcce-4c88-ac9e-f3198aa8de62 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:41.336038 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a18dd32d-dcce-4c88-ac9e-f3198aa8de62 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:41.336569 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a18dd32d-dcce-4c88-ac9e-f3198aa8de62 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:41.337445 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a18dd32d-dcce-4c88-ac9e-f3198aa8de62 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:41.337888 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a18dd32d-dcce-4c88-ac9e-f3198aa8de62 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:41.378453 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-aadadf96-fb10-4077-bf08-6ed22a7cce5b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1284309045", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-717045666", "security_groups": [{"name": "tempest-secgroup-smoke-1526997258"}], "block_device_mapping_v2": [{"uuid": "38e91cbf-eb15-4dfd-b552-e9336ef5d482", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f918dd3e-1cb0-4ec1-9ac3-73d6674790cf"}]}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:41.516252 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-a18dd32d-dcce-4c88-ac9e-f3198aa8de62 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:41.525838 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-a18dd32d-dcce-4c88-ac9e-f3198aa8de62 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1569 microversion: 2.1 time: 0.200476 May 10 16:50:41.527038 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 317/664] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:41 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:41.529640 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-aadadf96-fb10-4077-bf08-6ed22a7cce5b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] validate_networks() for [('f918dd3e-1cb0-4ec1-9ac3-73d6674790cf', None, None, None, None, None)] {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:50:41.889369 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-454d76b2-1021-4f73-8250-ba189104813c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:41.889862 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-454d76b2-1021-4f73-8250-ba189104813c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:41.898513 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-454d76b2-1021-4f73-8250-ba189104813c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:41.899062 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-454d76b2-1021-4f73-8250-ba189104813c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:41.899760 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-454d76b2-1021-4f73-8250-ba189104813c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:41.900196 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-454d76b2-1021-4f73-8250-ba189104813c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:42.065428 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-aadadf96-fb10-4077-bf08-6ed22a7cce5b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:50:42.065862 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-aadadf96-fb10-4077-bf08-6ed22a7cce5b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:50:42.066345 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-aadadf96-fb10-4077-bf08-6ed22a7cce5b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:50:42.067364 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-aadadf96-fb10-4077-bf08-6ed22a7cce5b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:50:42.067955 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-aadadf96-fb10-4077-bf08-6ed22a7cce5b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:50:42.077095 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aadadf96-fb10-4077-bf08-6ed22a7cce5b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:42.077512 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aadadf96-fb10-4077-bf08-6ed22a7cce5b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:42.078440 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aadadf96-fb10-4077-bf08-6ed22a7cce5b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:42.078810 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-aadadf96-fb10-4077-bf08-6ed22a7cce5b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:42.082923 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-454d76b2-1021-4f73-8250-ba189104813c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:42.090906 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-454d76b2-1021-4f73-8250-ba189104813c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:42.092432 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-454d76b2-1021-4f73-8250-ba189104813c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:42.093582 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-454d76b2-1021-4f73-8250-ba189104813c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1721 microversion: 2.20 time: 0.208550 May 10 16:50:42.094448 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 318/665] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:41 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:42.098677 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-aadadf96-fb10-4077-bf08-6ed22a7cce5b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Getting quotas for project 84465c37c1474aa68266191586ba2953. Resources: {'instances', 'cores', 'ram'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:50:42.102822 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-aadadf96-fb10-4077-bf08-6ed22a7cce5b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Getting quotas for user 1bc2420288964c389f6529d9ede09bd4 and project 84465c37c1474aa68266191586ba2953. Resources: {'instances', 'cores', 'ram'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:50:42.162994 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-aadadf96-fb10-4077-bf08-6ed22a7cce5b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:50:42.165101 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-aadadf96-fb10-4077-bf08-6ed22a7cce5b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: c0c4579c-80bf-472e-947e-5c462a9815b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='38e91cbf-eb15-4dfd-b552-e9336ef5d482',volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:50:42.298643 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-aadadf96-fb10-4077-bf08-6ed22a7cce5b tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.923965 May 10 16:50:42.300505 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 348/666] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 16:50:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 16:50:42.312640 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-cc80933d-0159-4aa8-aa23-dfb58a1f1fc3 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:42.313298 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-cc80933d-0159-4aa8-aa23-dfb58a1f1fc3 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: c0c4579c-80bf-472e-947e-5c462a9815b9] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:42.374413 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-cc80933d-0159-4aa8-aa23-dfb58a1f1fc3 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:42.381352 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-cc80933d-0159-4aa8-aa23-dfb58a1f1fc3 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9" status: 200 len: 1094 microversion: 2.1 time: 0.074103 May 10 16:50:42.381996 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 319/667] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:42 2022] GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:42.546294 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4c1b1de8-7e14-4355-ae1b-664a658c5c95 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:42.546911 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4c1b1de8-7e14-4355-ae1b-664a658c5c95 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:42.556459 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4c1b1de8-7e14-4355-ae1b-664a658c5c95 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:42.557109 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4c1b1de8-7e14-4355-ae1b-664a658c5c95 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:42.558270 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4c1b1de8-7e14-4355-ae1b-664a658c5c95 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:42.558715 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4c1b1de8-7e14-4355-ae1b-664a658c5c95 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:42.704392 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4c1b1de8-7e14-4355-ae1b-664a658c5c95 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:42.715665 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4c1b1de8-7e14-4355-ae1b-664a658c5c95 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1569 microversion: 2.1 time: 0.175299 May 10 16:50:42.716485 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 349/668] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:42 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:43.112038 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-bbdc5547-9283-44ad-aed9-93123ceecfb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:43.112632 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-bbdc5547-9283-44ad-aed9-93123ceecfb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:43.119333 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-bbdc5547-9283-44ad-aed9-93123ceecfb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:43.119789 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-bbdc5547-9283-44ad-aed9-93123ceecfb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:43.120587 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-bbdc5547-9283-44ad-aed9-93123ceecfb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:43.121200 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-bbdc5547-9283-44ad-aed9-93123ceecfb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:43.357638 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-bbdc5547-9283-44ad-aed9-93123ceecfb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:43.370615 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-bbdc5547-9283-44ad-aed9-93123ceecfb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:43.372798 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-bbdc5547-9283-44ad-aed9-93123ceecfb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:43.374543 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-bbdc5547-9283-44ad-aed9-93123ceecfb1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1721 microversion: 2.20 time: 0.266422 May 10 16:50:43.385904 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 320/669] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:43 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:43.398623 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-9a4412fd-5866-412b-b49d-b7ba8e6d51f6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:43.400083 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-9a4412fd-5866-412b-b49d-b7ba8e6d51f6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: c0c4579c-80bf-472e-947e-5c462a9815b9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:43.407545 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9a4412fd-5866-412b-b49d-b7ba8e6d51f6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:43.408278 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9a4412fd-5866-412b-b49d-b7ba8e6d51f6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:43.409847 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9a4412fd-5866-412b-b49d-b7ba8e6d51f6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:43.411055 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-9a4412fd-5866-412b-b49d-b7ba8e6d51f6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:43.560872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-9a4412fd-5866-412b-b49d-b7ba8e6d51f6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:43.569424 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-9a4412fd-5866-412b-b49d-b7ba8e6d51f6 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9" status: 200 len: 1200 microversion: 2.1 time: 0.175566 May 10 16:50:43.580281 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 350/670] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:43 2022] GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9 => generated 1200 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:43.733285 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-27e9d273-f3ca-4be3-b817-b738f4a553ed tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:43.733905 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-27e9d273-f3ca-4be3-b817-b738f4a553ed tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:43.742749 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-27e9d273-f3ca-4be3-b817-b738f4a553ed tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:43.743523 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-27e9d273-f3ca-4be3-b817-b738f4a553ed tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:43.744317 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-27e9d273-f3ca-4be3-b817-b738f4a553ed tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:43.745260 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-27e9d273-f3ca-4be3-b817-b738f4a553ed tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:44.083225 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-27e9d273-f3ca-4be3-b817-b738f4a553ed tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:44.093198 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-27e9d273-f3ca-4be3-b817-b738f4a553ed tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1569 microversion: 2.1 time: 0.363779 May 10 16:50:44.104907 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 321/671] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:43 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1569 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:44.394063 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c9177882-d837-4582-98c7-8de3855ec60c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:44.395675 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-c9177882-d837-4582-98c7-8de3855ec60c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:44.402048 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c9177882-d837-4582-98c7-8de3855ec60c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:44.402696 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c9177882-d837-4582-98c7-8de3855ec60c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:44.403574 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c9177882-d837-4582-98c7-8de3855ec60c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:44.404570 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-c9177882-d837-4582-98c7-8de3855ec60c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:44.587377 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-d2aa3e60-8f08-4c54-8ee1-c8b1385509fc tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:44.588651 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-d2aa3e60-8f08-4c54-8ee1-c8b1385509fc tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: c0c4579c-80bf-472e-947e-5c462a9815b9] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:44.595698 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d2aa3e60-8f08-4c54-8ee1-c8b1385509fc tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:44.596151 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d2aa3e60-8f08-4c54-8ee1-c8b1385509fc tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:44.596944 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d2aa3e60-8f08-4c54-8ee1-c8b1385509fc tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:44.598406 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d2aa3e60-8f08-4c54-8ee1-c8b1385509fc tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:44.837463 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-d2aa3e60-8f08-4c54-8ee1-c8b1385509fc tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:44.845719 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-d2aa3e60-8f08-4c54-8ee1-c8b1385509fc tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9" status: 200 len: 1198 microversion: 2.1 time: 0.262175 May 10 16:50:44.846530 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 322/672] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:44 2022] GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9 => generated 1198 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:45.008222 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c9177882-d837-4582-98c7-8de3855ec60c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:45.017151 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c9177882-d837-4582-98c7-8de3855ec60c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:45.018652 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-c9177882-d837-4582-98c7-8de3855ec60c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:45.020111 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c9177882-d837-4582-98c7-8de3855ec60c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1721 microversion: 2.20 time: 0.630399 May 10 16:50:45.021017 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 351/673] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:44 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1721 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:45.111877 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-6da74f73-852e-42ca-a00c-d9b708b98fe2 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:45.112589 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-6da74f73-852e-42ca-a00c-d9b708b98fe2 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:45.119008 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6da74f73-852e-42ca-a00c-d9b708b98fe2 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:45.119557 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6da74f73-852e-42ca-a00c-d9b708b98fe2 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:45.120395 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6da74f73-852e-42ca-a00c-d9b708b98fe2 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:45.120899 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6da74f73-852e-42ca-a00c-d9b708b98fe2 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:45.433223 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6da74f73-852e-42ca-a00c-d9b708b98fe2 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:45.451048 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-6da74f73-852e-42ca-a00c-d9b708b98fe2 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1569 microversion: 2.1 time: 0.343004 May 10 16:50:45.451634 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 323/674] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:45 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1569 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:45.863209 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0fd1da83-d0ad-4f16-a3ba-910e7232b189 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:45.864427 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0fd1da83-d0ad-4f16-a3ba-910e7232b189 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: c0c4579c-80bf-472e-947e-5c462a9815b9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:45.870587 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0fd1da83-d0ad-4f16-a3ba-910e7232b189 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:45.871062 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0fd1da83-d0ad-4f16-a3ba-910e7232b189 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:45.871827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0fd1da83-d0ad-4f16-a3ba-910e7232b189 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:45.872262 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0fd1da83-d0ad-4f16-a3ba-910e7232b189 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:46.040726 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-6bdbf811-1049-4a3e-8f91-cc184655b716 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:46.042024 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-6bdbf811-1049-4a3e-8f91-cc184655b716 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:46.051117 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6bdbf811-1049-4a3e-8f91-cc184655b716 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:46.052982 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6bdbf811-1049-4a3e-8f91-cc184655b716 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:46.054523 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6bdbf811-1049-4a3e-8f91-cc184655b716 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:46.055156 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6bdbf811-1049-4a3e-8f91-cc184655b716 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:46.087019 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0fd1da83-d0ad-4f16-a3ba-910e7232b189 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:46.098851 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0fd1da83-d0ad-4f16-a3ba-910e7232b189 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9" status: 200 len: 1266 microversion: 2.1 time: 0.239523 May 10 16:50:46.100057 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 352/675] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:45 2022] GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:46.381766 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6bdbf811-1049-4a3e-8f91-cc184655b716 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:46.396820 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6bdbf811-1049-4a3e-8f91-cc184655b716 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:46.399684 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6bdbf811-1049-4a3e-8f91-cc184655b716 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:46.405802 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-6bdbf811-1049-4a3e-8f91-cc184655b716 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1721 microversion: 2.20 time: 0.371202 May 10 16:50:46.414525 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 324/676] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:46 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1721 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:46.469238 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3996b3f6-b7fe-413d-aa52-887287646de9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:46.469890 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3996b3f6-b7fe-413d-aa52-887287646de9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:46.489576 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3996b3f6-b7fe-413d-aa52-887287646de9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:46.490036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3996b3f6-b7fe-413d-aa52-887287646de9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:46.490838 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3996b3f6-b7fe-413d-aa52-887287646de9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:46.501380 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3996b3f6-b7fe-413d-aa52-887287646de9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:46.669471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-4d650aa1-85f4-4707-81f3-a4edf313763a req-e0115c1a-5880-4cbe-bbc1-b32aa3a093cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c4579c-80bf-472e-947e-5c462a9815b9", "tag": "40f77e8c-82c4-483a-ba7f-bde1720036a7"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:46.697397 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-4d650aa1-85f4-4707-81f3-a4edf313763a req-e0115c1a-5880-4cbe-bbc1-b32aa3a093cd service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:46.698096 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-4d650aa1-85f4-4707-81f3-a4edf313763a req-e0115c1a-5880-4cbe-bbc1-b32aa3a093cd service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:46.712692 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-4d650aa1-85f4-4707-81f3-a4edf313763a req-e0115c1a-5880-4cbe-bbc1-b32aa3a093cd service nova] Creating event network-changed:40f77e8c-82c4-483a-ba7f-bde1720036a7 for instance c0c4579c-80bf-472e-947e-5c462a9815b9 on hv-cinder-84130 May 10 16:50:46.718778 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-4d650aa1-85f4-4707-81f3-a4edf313763a req-e0115c1a-5880-4cbe-bbc1-b32aa3a093cd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054281 May 10 16:50:46.719700 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 325/677] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:50:46.868945 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3996b3f6-b7fe-413d-aa52-887287646de9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:46.891895 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3996b3f6-b7fe-413d-aa52-887287646de9 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1569 microversion: 2.1 time: 0.427545 May 10 16:50:46.893582 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 353/678] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:46 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1569 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:47.118722 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-ad9727d3-1b43-4a61-91aa-1ff3d8694a1c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:47.120095 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-ad9727d3-1b43-4a61-91aa-1ff3d8694a1c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: c0c4579c-80bf-472e-947e-5c462a9815b9] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:47.126294 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ad9727d3-1b43-4a61-91aa-1ff3d8694a1c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:47.131776 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ad9727d3-1b43-4a61-91aa-1ff3d8694a1c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:47.132702 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ad9727d3-1b43-4a61-91aa-1ff3d8694a1c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:47.134791 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ad9727d3-1b43-4a61-91aa-1ff3d8694a1c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:47.327735 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ad9727d3-1b43-4a61-91aa-1ff3d8694a1c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:47.341633 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-ad9727d3-1b43-4a61-91aa-1ff3d8694a1c tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9" status: 200 len: 1266 microversion: 2.1 time: 0.224307 May 10 16:50:47.343092 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 326/679] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:47 2022] GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:47.425383 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-03df4160-1463-4456-9eb2-81ac8a1934ea tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:47.426258 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-03df4160-1463-4456-9eb2-81ac8a1934ea tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:47.432977 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-03df4160-1463-4456-9eb2-81ac8a1934ea tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:47.433445 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-03df4160-1463-4456-9eb2-81ac8a1934ea tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:47.434341 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-03df4160-1463-4456-9eb2-81ac8a1934ea tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:47.434853 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-03df4160-1463-4456-9eb2-81ac8a1934ea tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:47.643149 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-03df4160-1463-4456-9eb2-81ac8a1934ea tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:47.684731 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-03df4160-1463-4456-9eb2-81ac8a1934ea tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:47.686209 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-03df4160-1463-4456-9eb2-81ac8a1934ea tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:47.687446 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-03df4160-1463-4456-9eb2-81ac8a1934ea tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1721 microversion: 2.20 time: 0.266201 May 10 16:50:47.687997 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 354/680] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:47 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1721 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:47.909548 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-7d6b6954-39d2-4d58-8738-4a7f50d70dd7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:47.911213 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-7d6b6954-39d2-4d58-8738-4a7f50d70dd7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:47.925417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7d6b6954-39d2-4d58-8738-4a7f50d70dd7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:47.926107 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7d6b6954-39d2-4d58-8738-4a7f50d70dd7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:47.927330 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7d6b6954-39d2-4d58-8738-4a7f50d70dd7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:47.928443 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7d6b6954-39d2-4d58-8738-4a7f50d70dd7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:48.155487 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7d6b6954-39d2-4d58-8738-4a7f50d70dd7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:48.165515 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-7d6b6954-39d2-4d58-8738-4a7f50d70dd7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1569 microversion: 2.1 time: 0.259995 May 10 16:50:48.178687 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 327/681] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:47 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1569 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:48.363465 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0e6b235a-761b-4d38-81ab-7d1c9c2a9085 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:48.364730 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0e6b235a-761b-4d38-81ab-7d1c9c2a9085 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: c0c4579c-80bf-472e-947e-5c462a9815b9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:48.373872 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0e6b235a-761b-4d38-81ab-7d1c9c2a9085 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:48.374752 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0e6b235a-761b-4d38-81ab-7d1c9c2a9085 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:48.376229 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0e6b235a-761b-4d38-81ab-7d1c9c2a9085 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:48.376839 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0e6b235a-761b-4d38-81ab-7d1c9c2a9085 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:48.541760 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0e6b235a-761b-4d38-81ab-7d1c9c2a9085 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:48.548979 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0e6b235a-761b-4d38-81ab-7d1c9c2a9085 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9" status: 200 len: 1266 microversion: 2.1 time: 0.191968 May 10 16:50:48.549912 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 355/682] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:48 2022] GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:48.705647 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d374eeaa-61d0-49a5-b675-c561876e8efd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:48.706300 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d374eeaa-61d0-49a5-b675-c561876e8efd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:48.712704 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d374eeaa-61d0-49a5-b675-c561876e8efd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:48.713156 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d374eeaa-61d0-49a5-b675-c561876e8efd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:48.713933 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d374eeaa-61d0-49a5-b675-c561876e8efd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:48.714374 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d374eeaa-61d0-49a5-b675-c561876e8efd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:48.733636 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f306c0ed-4042-4911-926b-9488ffe73525 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Action: 'create', calling method: .version_select at 0x7fdf195100d0>, body: {"keypair": {"name": "tempest-keypair-2129290259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjktSO+A43vYxn19lpABgACLipeIOSPCvaHNJ3Dm2Hw4QC8aMkqZjSoPuZCfFfpn9mQJ92Ttc9FE0WW85wLHuEQO/KPjVT4ZpNM58biUUIBaFosgFLrCzUd9uT8aHeLKA=="}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:48.747697 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-f306c0ed-4042-4911-926b-9488ffe73525 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Getting quotas for project c689db207d9b4ca7af21395734fc14d5. Resources: {'key_pairs'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:50:48.751510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.quota [None req-f306c0ed-4042-4911-926b-9488ffe73525 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Getting quotas for user f037681adf2f4d5a8585e3a8820534ea and project c689db207d9b4ca7af21395734fc14d5. Resources: {'key_pairs'} {{(pid=128925) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:50:48.776978 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-f306c0ed-4042-4911-926b-9488ffe73525 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154122 May 10 16:50:48.777641 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 328/683] 10.222.0.57 () {60 vars in 1158 bytes} [Tue May 10 16:50:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:50:48.865597 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d374eeaa-61d0-49a5-b675-c561876e8efd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:48.873470 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d374eeaa-61d0-49a5-b675-c561876e8efd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:48.875121 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d374eeaa-61d0-49a5-b675-c561876e8efd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:48.876599 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d374eeaa-61d0-49a5-b675-c561876e8efd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1721 microversion: 2.20 time: 0.174852 May 10 16:50:48.877238 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 356/684] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:48 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:50:49.184408 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-51fc4016-1e00-4c9b-8d4c-75fa69559154 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:49.185500 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-51fc4016-1e00-4c9b-8d4c-75fa69559154 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:49.191913 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-51fc4016-1e00-4c9b-8d4c-75fa69559154 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:49.192413 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-51fc4016-1e00-4c9b-8d4c-75fa69559154 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:49.193205 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-51fc4016-1e00-4c9b-8d4c-75fa69559154 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:49.193984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-51fc4016-1e00-4c9b-8d4c-75fa69559154 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:49.345917 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-51fc4016-1e00-4c9b-8d4c-75fa69559154 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:49.354515 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-51fc4016-1e00-4c9b-8d4c-75fa69559154 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1569 microversion: 2.1 time: 0.175093 May 10 16:50:49.355340 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 329/685] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:49 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:49.565878 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f2886a93-209f-4c1e-96ce-5ef318a62aa8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:49.566553 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f2886a93-209f-4c1e-96ce-5ef318a62aa8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: c0c4579c-80bf-472e-947e-5c462a9815b9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:49.572891 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f2886a93-209f-4c1e-96ce-5ef318a62aa8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:49.573491 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f2886a93-209f-4c1e-96ce-5ef318a62aa8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:49.574379 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f2886a93-209f-4c1e-96ce-5ef318a62aa8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:49.575075 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f2886a93-209f-4c1e-96ce-5ef318a62aa8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:49.743666 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f2886a93-209f-4c1e-96ce-5ef318a62aa8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:49.753763 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f2886a93-209f-4c1e-96ce-5ef318a62aa8 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9" status: 200 len: 1266 microversion: 2.1 time: 0.191703 May 10 16:50:49.754411 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 357/686] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:49 2022] GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:49.895924 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-28040634-6523-4076-8c66-43e6f037ed29 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:49.896534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-28040634-6523-4076-8c66-43e6f037ed29 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:49.904013 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-28040634-6523-4076-8c66-43e6f037ed29 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:49.904463 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-28040634-6523-4076-8c66-43e6f037ed29 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:49.906250 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-28040634-6523-4076-8c66-43e6f037ed29 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:49.906696 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-28040634-6523-4076-8c66-43e6f037ed29 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:50.060918 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-28040634-6523-4076-8c66-43e6f037ed29 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:50.069446 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-28040634-6523-4076-8c66-43e6f037ed29 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:50.071249 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-28040634-6523-4076-8c66-43e6f037ed29 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:50.073521 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-28040634-6523-4076-8c66-43e6f037ed29 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1742 microversion: 2.20 time: 0.181914 May 10 16:50:50.085650 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 330/687] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:49 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1742 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:50.164595 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-60b446ef-d646-4e03-955a-1677e9f3d7c2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1482586794", "imageRef": "3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d730775d-dcde-40f5-8842-688a26bd20de"}], "security_groups": [{"name": "tempest-securitygroup--551773747"}], "key_name": "tempest-keypair-2129290259", "user_data": "}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:50.314167 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.network.neutron [None req-60b446ef-d646-4e03-955a-1677e9f3d7c2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] validate_networks() for [('d730775d-dcde-40f5-8842-688a26bd20de', None, None, None, None, None)] {{(pid=128924) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 16:50:50.372318 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-e7f6bd0f-4d74-4738-8b8b-743730a03ad7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:50.372864 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-e7f6bd0f-4d74-4738-8b8b-743730a03ad7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:50.381585 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e7f6bd0f-4d74-4738-8b8b-743730a03ad7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:50.382037 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e7f6bd0f-4d74-4738-8b8b-743730a03ad7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:50.382828 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e7f6bd0f-4d74-4738-8b8b-743730a03ad7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:50.387512 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e7f6bd0f-4d74-4738-8b8b-743730a03ad7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:50.602632 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-e7f6bd0f-4d74-4738-8b8b-743730a03ad7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:50.610890 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-e7f6bd0f-4d74-4738-8b8b-743730a03ad7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1570 microversion: 2.1 time: 0.242417 May 10 16:50:50.611493 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 331/688] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:50 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1570 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:50.627439 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-2bc41b2e-d227-4344-9bb7-7644c977f54b tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:50.628009 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-2bc41b2e-d227-4344-9bb7-7644c977f54b tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:50.634774 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2bc41b2e-d227-4344-9bb7-7644c977f54b tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:50.635512 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2bc41b2e-d227-4344-9bb7-7644c977f54b tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:50.636532 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2bc41b2e-d227-4344-9bb7-7644c977f54b tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:50.637200 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2bc41b2e-d227-4344-9bb7-7644c977f54b tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:50.724077 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-2bc41b2e-d227-4344-9bb7-7644c977f54b tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "POST /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24/action" status: 202 len: 0 microversion: 2.1 time: 0.099821 May 10 16:50:50.729816 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 332/689] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 16:50:50 2022] POST /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 16:50:50.735577 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-5e74e4c9-5e1a-47ea-b14e-57e1b9336cb1 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:50.736441 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-5e74e4c9-5e1a-47ea-b14e-57e1b9336cb1 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:50.745399 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5e74e4c9-5e1a-47ea-b14e-57e1b9336cb1 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:50.746025 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5e74e4c9-5e1a-47ea-b14e-57e1b9336cb1 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:50.747167 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5e74e4c9-5e1a-47ea-b14e-57e1b9336cb1 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:50.747795 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5e74e4c9-5e1a-47ea-b14e-57e1b9336cb1 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:50.879850 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-60b446ef-d646-4e03-955a-1677e9f3d7c2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Flavor limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 16:50:50.880807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-60b446ef-d646-4e03-955a-1677e9f3d7c2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Image limits 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 16:50:50.881442 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-60b446ef-d646-4e03-955a-1677e9f3d7c2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Flavor pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 16:50:50.882015 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-60b446ef-d646-4e03-955a-1677e9f3d7c2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Image pref 0:0:0 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 16:50:50.882591 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.virt.hardware [None req-60b446ef-d646-4e03-955a-1677e9f3d7c2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128924) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 16:50:50.893780 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-60b446ef-d646-4e03-955a-1677e9f3d7c2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:50.894802 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-60b446ef-d646-4e03-955a-1677e9f3d7c2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:50.899975 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-60b446ef-d646-4e03-955a-1677e9f3d7c2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:50.900601 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-60b446ef-d646-4e03-955a-1677e9f3d7c2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:50.921293 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-60b446ef-d646-4e03-955a-1677e9f3d7c2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Getting quotas for project c689db207d9b4ca7af21395734fc14d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 16:50:50.925702 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.quota [None req-60b446ef-d646-4e03-955a-1677e9f3d7c2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Getting quotas for user f037681adf2f4d5a8585e3a8820534ea and project c689db207d9b4ca7af21395734fc14d5. Resources: {'instances', 'cores', 'ram'} {{(pid=128924) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 16:50:50.937440 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-60b446ef-d646-4e03-955a-1677e9f3d7c2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Going to run 1 instances... {{(pid=128924) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 16:50:50.939644 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-60b446ef-d646-4e03-955a-1677e9f3d7c2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3a675b0b-50dc-4261-8fd6-8c9e6b5e0c8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128924) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 16:50:50.995567 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-60b446ef-d646-4e03-955a-1677e9f3d7c2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.834221 May 10 16:50:50.997123 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 358/690] 10.222.0.57 () {60 vars in 1146 bytes} [Tue May 10 16:50:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 16:50:51.004328 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0193b221-b49d-463d-83fc-974f18d8ac57 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:51.005506 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0193b221-b49d-463d-83fc-974f18d8ac57 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: c0c4579c-80bf-472e-947e-5c462a9815b9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:51.015300 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0193b221-b49d-463d-83fc-974f18d8ac57 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:51.015976 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0193b221-b49d-463d-83fc-974f18d8ac57 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:51.017024 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0193b221-b49d-463d-83fc-974f18d8ac57 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:51.017634 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0193b221-b49d-463d-83fc-974f18d8ac57 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:51.054231 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-5e74e4c9-5e1a-47ea-b14e-57e1b9336cb1 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:51.097348 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-5e74e4c9-5e1a-47ea-b14e-57e1b9336cb1 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1578 microversion: 2.1 time: 0.366095 May 10 16:50:51.098085 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 333/691] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:50 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1578 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:51.103017 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b686f827-de23-420b-a033-7a704d51bfbd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:51.103844 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-b686f827-de23-420b-a033-7a704d51bfbd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:51.485366 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b686f827-de23-420b-a033-7a704d51bfbd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:51.497100 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b686f827-de23-420b-a033-7a704d51bfbd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1238 microversion: 2.1 time: 0.397637 May 10 16:50:51.497734 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 334/692] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:51 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1238 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:51.511663 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-32be63f5-4ac1-455d-80e1-42128936dd15 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:51.512674 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-32be63f5-4ac1-455d-80e1-42128936dd15 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:51.515497 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0193b221-b49d-463d-83fc-974f18d8ac57 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:51.523989 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-32be63f5-4ac1-455d-80e1-42128936dd15 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:51.524335 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0193b221-b49d-463d-83fc-974f18d8ac57 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9" status: 200 len: 1266 microversion: 2.1 time: 0.524917 May 10 16:50:51.525214 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-32be63f5-4ac1-455d-80e1-42128936dd15 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:51.525594 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 359/693] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:50 2022] GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9 => generated 1266 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:51.527440 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-32be63f5-4ac1-455d-80e1-42128936dd15 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:51.527880 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-32be63f5-4ac1-455d-80e1-42128936dd15 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:51.741708 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-32be63f5-4ac1-455d-80e1-42128936dd15 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:51.754191 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-32be63f5-4ac1-455d-80e1-42128936dd15 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:51.756120 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-32be63f5-4ac1-455d-80e1-42128936dd15 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:51.760764 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-32be63f5-4ac1-455d-80e1-42128936dd15 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1742 microversion: 2.20 time: 0.259950 May 10 16:50:51.761782 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 335/694] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:51 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1742 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:52.115008 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-712cdcf4-b402-432b-b633-72230c3a9883 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:52.115788 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-712cdcf4-b402-432b-b633-72230c3a9883 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:52.123995 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-712cdcf4-b402-432b-b633-72230c3a9883 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:52.124458 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-712cdcf4-b402-432b-b633-72230c3a9883 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:52.125250 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-712cdcf4-b402-432b-b633-72230c3a9883 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:52.125693 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-712cdcf4-b402-432b-b633-72230c3a9883 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:52.280104 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-712cdcf4-b402-432b-b633-72230c3a9883 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:52.288642 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-712cdcf4-b402-432b-b633-72230c3a9883 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1520 microversion: 2.1 time: 0.177550 May 10 16:50:52.289874 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 360/695] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:52 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:52.518854 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1bf951e8-33c1-4006-abf8-b08ecdf52b9a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:52.521241 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-1bf951e8-33c1-4006-abf8-b08ecdf52b9a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:52.531820 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1bf951e8-33c1-4006-abf8-b08ecdf52b9a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:52.532810 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1bf951e8-33c1-4006-abf8-b08ecdf52b9a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:52.541356 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-87df116f-82f0-4a62-8150-a9941f204394 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:52.541980 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-87df116f-82f0-4a62-8150-a9941f204394 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: c0c4579c-80bf-472e-947e-5c462a9815b9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:52.542189 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1bf951e8-33c1-4006-abf8-b08ecdf52b9a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:52.542654 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1bf951e8-33c1-4006-abf8-b08ecdf52b9a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:52.557151 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-87df116f-82f0-4a62-8150-a9941f204394 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:52.558934 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-87df116f-82f0-4a62-8150-a9941f204394 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:52.563080 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-87df116f-82f0-4a62-8150-a9941f204394 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:52.563526 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-87df116f-82f0-4a62-8150-a9941f204394 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:52.626992 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-1bf951e8-33c1-4006-abf8-b08ecdf52b9a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:52.639639 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-1bf951e8-33c1-4006-abf8-b08ecdf52b9a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1308 microversion: 2.1 time: 0.129611 May 10 16:50:52.640251 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 336/696] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:52 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1308 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:52.732276 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-87df116f-82f0-4a62-8150-a9941f204394 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:52.749129 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-87df116f-82f0-4a62-8150-a9941f204394 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9" status: 200 len: 1266 microversion: 2.1 time: 0.211450 May 10 16:50:52.758928 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 361/697] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:52 2022] GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:52.780778 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-e3922891-a4dd-413f-98f5-ae549a99613d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:52.781502 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-e3922891-a4dd-413f-98f5-ae549a99613d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:52.787855 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e3922891-a4dd-413f-98f5-ae549a99613d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:52.788581 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e3922891-a4dd-413f-98f5-ae549a99613d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:52.789187 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e3922891-a4dd-413f-98f5-ae549a99613d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:52.789694 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e3922891-a4dd-413f-98f5-ae549a99613d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:52.955758 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-e3922891-a4dd-413f-98f5-ae549a99613d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:52.964060 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-e3922891-a4dd-413f-98f5-ae549a99613d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:52.965565 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-e3922891-a4dd-413f-98f5-ae549a99613d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:52.966726 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-e3922891-a4dd-413f-98f5-ae549a99613d tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1737 microversion: 2.20 time: 0.190649 May 10 16:50:52.978886 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 337/698] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:52 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:53.327730 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-394eb7a0-391d-4901-bba6-5fc04f61fd76 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:53.328488 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-394eb7a0-391d-4901-bba6-5fc04f61fd76 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:53.345512 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-394eb7a0-391d-4901-bba6-5fc04f61fd76 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:53.346813 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-394eb7a0-391d-4901-bba6-5fc04f61fd76 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:53.348399 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-394eb7a0-391d-4901-bba6-5fc04f61fd76 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:53.348857 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-394eb7a0-391d-4901-bba6-5fc04f61fd76 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:53.616023 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-394eb7a0-391d-4901-bba6-5fc04f61fd76 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:53.623816 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-394eb7a0-391d-4901-bba6-5fc04f61fd76 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1576 microversion: 2.1 time: 0.321342 May 10 16:50:53.624789 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 362/699] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:53 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1576 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:53.657930 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b8d56f7c-e657-47c9-8667-4056d6b8cb69 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:53.659249 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-b8d56f7c-e657-47c9-8667-4056d6b8cb69 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:53.666038 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b8d56f7c-e657-47c9-8667-4056d6b8cb69 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:53.666786 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b8d56f7c-e657-47c9-8667-4056d6b8cb69 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:53.667794 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b8d56f7c-e657-47c9-8667-4056d6b8cb69 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:53.668462 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b8d56f7c-e657-47c9-8667-4056d6b8cb69 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:53.767015 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b6eeef2c-e745-4ab7-8303-b8ab68181b6d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:53.767735 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b6eeef2c-e745-4ab7-8303-b8ab68181b6d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: c0c4579c-80bf-472e-947e-5c462a9815b9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:53.793673 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6eeef2c-e745-4ab7-8303-b8ab68181b6d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:53.796615 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6eeef2c-e745-4ab7-8303-b8ab68181b6d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:53.798153 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6eeef2c-e745-4ab7-8303-b8ab68181b6d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:53.799306 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b6eeef2c-e745-4ab7-8303-b8ab68181b6d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:54.156437 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b8d56f7c-e657-47c9-8667-4056d6b8cb69 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:54.164725 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b8d56f7c-e657-47c9-8667-4056d6b8cb69 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1363 microversion: 2.1 time: 0.511643 May 10 16:50:54.177344 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 338/700] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:53 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1363 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:54.234013 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b6eeef2c-e745-4ab7-8303-b8ab68181b6d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:54.250382 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b6eeef2c-e745-4ab7-8303-b8ab68181b6d tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9" status: 200 len: 1266 microversion: 2.1 time: 0.488091 May 10 16:50:54.258335 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 363/701] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:53 2022] GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9 => generated 1266 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:54.264488 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a32a71a2-9f02-483f-a347-fd1bd9cdf7e1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:54.265106 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a32a71a2-9f02-483f-a347-fd1bd9cdf7e1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:54.284185 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a32a71a2-9f02-483f-a347-fd1bd9cdf7e1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:54.284567 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-49785de0-1c13-40aa-a702-b890731504ed req-8f6da301-928c-47ce-9969-5df649df9162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97528e0b-5eec-4ed3-aa10-b4d56c9803ca", "name": "network-vif-plugged", "status": "completed", "tag": "f3864dfb-e0b5-4e42-879e-b9da171ec437"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:54.284894 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a32a71a2-9f02-483f-a347-fd1bd9cdf7e1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:54.285918 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a32a71a2-9f02-483f-a347-fd1bd9cdf7e1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:54.286473 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a32a71a2-9f02-483f-a347-fd1bd9cdf7e1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:54.304551 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-49785de0-1c13-40aa-a702-b890731504ed req-8f6da301-928c-47ce-9969-5df649df9162 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:54.305150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-49785de0-1c13-40aa-a702-b890731504ed req-8f6da301-928c-47ce-9969-5df649df9162 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:54.328886 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-49785de0-1c13-40aa-a702-b890731504ed req-8f6da301-928c-47ce-9969-5df649df9162 service nova] Creating event network-vif-plugged:f3864dfb-e0b5-4e42-879e-b9da171ec437 for instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca on hv-cinder-84130 May 10 16:50:54.343900 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-49785de0-1c13-40aa-a702-b890731504ed req-8f6da301-928c-47ce-9969-5df649df9162 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171646 May 10 16:50:54.345176 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 339/702] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:50:54.586526 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a32a71a2-9f02-483f-a347-fd1bd9cdf7e1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:54.594731 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a32a71a2-9f02-483f-a347-fd1bd9cdf7e1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:54.596637 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a32a71a2-9f02-483f-a347-fd1bd9cdf7e1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:54.597470 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a32a71a2-9f02-483f-a347-fd1bd9cdf7e1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1737 microversion: 2.20 time: 0.337106 May 10 16:50:54.600723 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 364/703] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:54 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1737 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:54.642600 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-28a3b77c-434b-4486-9b26-540485b6828a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:54.643305 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-28a3b77c-434b-4486-9b26-540485b6828a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:54.666669 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-28a3b77c-434b-4486-9b26-540485b6828a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:54.667171 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-28a3b77c-434b-4486-9b26-540485b6828a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:54.668913 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-28a3b77c-434b-4486-9b26-540485b6828a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:54.669366 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-28a3b77c-434b-4486-9b26-540485b6828a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:54.754463 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-d0cec9c4-6e7f-4ba6-9c85-358b13a8e421 req-d6643026-6fc4-433f-a948-ba78b28fcaa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1f4723b-a74f-41ff-a8d8-eef312c22daf", "tag": "187771e7-4855-42c3-831b-feddd5408cb4"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:54.770851 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-d0cec9c4-6e7f-4ba6-9c85-358b13a8e421 req-d6643026-6fc4-433f-a948-ba78b28fcaa9 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:54.771823 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-d0cec9c4-6e7f-4ba6-9c85-358b13a8e421 req-d6643026-6fc4-433f-a948-ba78b28fcaa9 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:54.790818 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-d0cec9c4-6e7f-4ba6-9c85-358b13a8e421 req-d6643026-6fc4-433f-a948-ba78b28fcaa9 service nova] Creating event network-changed:187771e7-4855-42c3-831b-feddd5408cb4 for instance f1f4723b-a74f-41ff-a8d8-eef312c22daf on hv-cinder-84130 May 10 16:50:54.808234 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-d0cec9c4-6e7f-4ba6-9c85-358b13a8e421 req-d6643026-6fc4-433f-a948-ba78b28fcaa9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187804 May 10 16:50:54.808852 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 340/704] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:50:54.954888 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-28a3b77c-434b-4486-9b26-540485b6828a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:54.962728 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-28a3b77c-434b-4486-9b26-540485b6828a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1576 microversion: 2.1 time: 0.324699 May 10 16:50:54.989473 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 365/705] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:54 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1576 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:55.185961 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1e7a1fdc-8f8f-43d3-897c-09e286f87fb8 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:55.187133 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-1e7a1fdc-8f8f-43d3-897c-09e286f87fb8 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:55.193854 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1e7a1fdc-8f8f-43d3-897c-09e286f87fb8 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:55.194542 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1e7a1fdc-8f8f-43d3-897c-09e286f87fb8 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:55.195360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1e7a1fdc-8f8f-43d3-897c-09e286f87fb8 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:55.195796 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1e7a1fdc-8f8f-43d3-897c-09e286f87fb8 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:55.267781 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3575bb6c-4b0f-467c-bcf7-d83e9b279d8f tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:55.268899 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3575bb6c-4b0f-467c-bcf7-d83e9b279d8f tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: c0c4579c-80bf-472e-947e-5c462a9815b9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:55.276171 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3575bb6c-4b0f-467c-bcf7-d83e9b279d8f tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:55.276934 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3575bb6c-4b0f-467c-bcf7-d83e9b279d8f tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:55.277798 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3575bb6c-4b0f-467c-bcf7-d83e9b279d8f tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:55.278479 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3575bb6c-4b0f-467c-bcf7-d83e9b279d8f tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:55.400569 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-1e7a1fdc-8f8f-43d3-897c-09e286f87fb8 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:55.415383 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-1e7a1fdc-8f8f-43d3-897c-09e286f87fb8 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1363 microversion: 2.1 time: 0.233834 May 10 16:50:55.415973 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 341/706] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:55 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:55.480711 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3575bb6c-4b0f-467c-bcf7-d83e9b279d8f tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:55.495699 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3575bb6c-4b0f-467c-bcf7-d83e9b279d8f tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9" status: 200 len: 1266 microversion: 2.1 time: 0.227924 May 10 16:50:55.515559 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 366/707] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:55 2022] GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:55.619385 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1a7fb317-ee67-454e-8b45-85db1376c6c4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:55.621373 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-1a7fb317-ee67-454e-8b45-85db1376c6c4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:55.629705 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1a7fb317-ee67-454e-8b45-85db1376c6c4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:55.630302 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1a7fb317-ee67-454e-8b45-85db1376c6c4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:55.631603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1a7fb317-ee67-454e-8b45-85db1376c6c4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:55.632163 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1a7fb317-ee67-454e-8b45-85db1376c6c4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:55.803136 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-1a7fb317-ee67-454e-8b45-85db1376c6c4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:55.822540 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-1a7fb317-ee67-454e-8b45-85db1376c6c4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:55.825200 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-1a7fb317-ee67-454e-8b45-85db1376c6c4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:55.826567 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-1a7fb317-ee67-454e-8b45-85db1376c6c4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1737 microversion: 2.20 time: 0.214883 May 10 16:50:55.838203 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 342/708] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:55 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:55.993320 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3efc1a49-555e-4d62-9ced-56cabe2617c4 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:55.993848 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3efc1a49-555e-4d62-9ced-56cabe2617c4 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:56.002641 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3efc1a49-555e-4d62-9ced-56cabe2617c4 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:56.003135 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3efc1a49-555e-4d62-9ced-56cabe2617c4 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:56.003922 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3efc1a49-555e-4d62-9ced-56cabe2617c4 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:56.004358 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3efc1a49-555e-4d62-9ced-56cabe2617c4 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:56.143814 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3efc1a49-555e-4d62-9ced-56cabe2617c4 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:56.151812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3efc1a49-555e-4d62-9ced-56cabe2617c4 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1576 microversion: 2.1 time: 0.162694 May 10 16:50:56.163398 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 367/709] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:55 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:56.363526 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-5efca6b3-525c-4dfe-8357-f1f59d5c8ab6 req-8e4cdb57-8353-4950-ab1e-04dd15f6fad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b14b06-9428-41e6-ae67-68b253218e24", "name": "network-vif-unplugged", "status": "completed", "tag": "fdeeb8a2-0f74-40ea-acb1-f138b641a2ce"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:56.372510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-5efca6b3-525c-4dfe-8357-f1f59d5c8ab6 req-8e4cdb57-8353-4950-ab1e-04dd15f6fad2 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:56.373300 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-5efca6b3-525c-4dfe-8357-f1f59d5c8ab6 req-8e4cdb57-8353-4950-ab1e-04dd15f6fad2 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:56.396887 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-5efca6b3-525c-4dfe-8357-f1f59d5c8ab6 req-8e4cdb57-8353-4950-ab1e-04dd15f6fad2 service nova] Creating event network-vif-unplugged:fdeeb8a2-0f74-40ea-acb1-f138b641a2ce for instance 25b14b06-9428-41e6-ae67-68b253218e24 on hv-cinder-84130 May 10 16:50:56.417011 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-5efca6b3-525c-4dfe-8357-f1f59d5c8ab6 req-8e4cdb57-8353-4950-ab1e-04dd15f6fad2 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057410 May 10 16:50:56.417714 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 343/710] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:50:56.432657 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-1b0f3726-1c9b-4f6d-a8ce-3d926b6fb6a6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:56.433497 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-1b0f3726-1c9b-4f6d-a8ce-3d926b6fb6a6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:56.447148 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b0f3726-1c9b-4f6d-a8ce-3d926b6fb6a6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:56.447978 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b0f3726-1c9b-4f6d-a8ce-3d926b6fb6a6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:56.448878 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b0f3726-1c9b-4f6d-a8ce-3d926b6fb6a6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:56.449657 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-1b0f3726-1c9b-4f6d-a8ce-3d926b6fb6a6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:56.514733 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b7ce4648-6d0c-4271-85f5-c2e999b19403 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:56.515541 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-b7ce4648-6d0c-4271-85f5-c2e999b19403 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: c0c4579c-80bf-472e-947e-5c462a9815b9] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:56.528394 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b7ce4648-6d0c-4271-85f5-c2e999b19403 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:56.528851 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b7ce4648-6d0c-4271-85f5-c2e999b19403 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:56.533101 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b7ce4648-6d0c-4271-85f5-c2e999b19403 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:56.534618 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b7ce4648-6d0c-4271-85f5-c2e999b19403 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:56.679139 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-1b0f3726-1c9b-4f6d-a8ce-3d926b6fb6a6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:56.689549 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-1b0f3726-1c9b-4f6d-a8ce-3d926b6fb6a6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1363 microversion: 2.1 time: 0.261114 May 10 16:50:56.699663 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 368/711] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:56 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:56.758458 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b7ce4648-6d0c-4271-85f5-c2e999b19403 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:56.765976 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b7ce4648-6d0c-4271-85f5-c2e999b19403 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9" status: 200 len: 1266 microversion: 2.1 time: 0.255891 May 10 16:50:56.766556 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 344/712] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:56 2022] GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:56.845465 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0e29e7e3-0a2c-48c1-8b03-ddacedeca9fd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:56.846222 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0e29e7e3-0a2c-48c1-8b03-ddacedeca9fd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:56.852433 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0e29e7e3-0a2c-48c1-8b03-ddacedeca9fd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:56.852961 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0e29e7e3-0a2c-48c1-8b03-ddacedeca9fd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:56.853807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0e29e7e3-0a2c-48c1-8b03-ddacedeca9fd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:56.854313 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0e29e7e3-0a2c-48c1-8b03-ddacedeca9fd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:57.032045 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0e29e7e3-0a2c-48c1-8b03-ddacedeca9fd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:57.041891 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0e29e7e3-0a2c-48c1-8b03-ddacedeca9fd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:57.043526 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0e29e7e3-0a2c-48c1-8b03-ddacedeca9fd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:57.044634 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0e29e7e3-0a2c-48c1-8b03-ddacedeca9fd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1737 microversion: 2.20 time: 0.203022 May 10 16:50:57.054992 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 369/713] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:56 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:57.170311 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-4d109461-4e07-4ad8-ab76-66214d9ec387 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:57.171285 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-4d109461-4e07-4ad8-ab76-66214d9ec387 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:57.181340 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4d109461-4e07-4ad8-ab76-66214d9ec387 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:57.181784 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4d109461-4e07-4ad8-ab76-66214d9ec387 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:57.182558 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4d109461-4e07-4ad8-ab76-66214d9ec387 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:57.183011 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4d109461-4e07-4ad8-ab76-66214d9ec387 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:57.335210 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-4d109461-4e07-4ad8-ab76-66214d9ec387 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:57.343460 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-4d109461-4e07-4ad8-ab76-66214d9ec387 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1576 microversion: 2.1 time: 0.177727 May 10 16:50:57.344030 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 345/714] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:57 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:57.709777 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a938d25b-7fc4-499f-acaf-265da0182b82 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:57.711245 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a938d25b-7fc4-499f-acaf-265da0182b82 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:57.720522 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a938d25b-7fc4-499f-acaf-265da0182b82 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:57.721844 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a938d25b-7fc4-499f-acaf-265da0182b82 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:57.723653 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a938d25b-7fc4-499f-acaf-265da0182b82 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:57.724338 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a938d25b-7fc4-499f-acaf-265da0182b82 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:57.789433 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-00ce86b5-9411-4a97-9569-3ebf35674a85 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:57.790062 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-00ce86b5-9411-4a97-9569-3ebf35674a85 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: c0c4579c-80bf-472e-947e-5c462a9815b9] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:57.799024 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-00ce86b5-9411-4a97-9569-3ebf35674a85 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:57.799484 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-00ce86b5-9411-4a97-9569-3ebf35674a85 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:57.806452 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-00ce86b5-9411-4a97-9569-3ebf35674a85 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:57.806646 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-00ce86b5-9411-4a97-9569-3ebf35674a85 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:57.934751 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a938d25b-7fc4-499f-acaf-265da0182b82 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:57.951711 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a938d25b-7fc4-499f-acaf-265da0182b82 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1363 microversion: 2.1 time: 0.243767 May 10 16:50:57.953096 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 370/715] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:57 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:58.016422 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-00ce86b5-9411-4a97-9569-3ebf35674a85 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:58.027773 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-00ce86b5-9411-4a97-9569-3ebf35674a85 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9" status: 200 len: 1266 microversion: 2.1 time: 0.244145 May 10 16:50:58.028668 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 346/716] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:57 2022] GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:58.066287 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-d8f992db-1606-4cf3-9b7a-c72705a6b59f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:58.066931 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-d8f992db-1606-4cf3-9b7a-c72705a6b59f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:58.073223 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d8f992db-1606-4cf3-9b7a-c72705a6b59f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:58.073753 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d8f992db-1606-4cf3-9b7a-c72705a6b59f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:58.074609 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d8f992db-1606-4cf3-9b7a-c72705a6b59f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:58.076221 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-d8f992db-1606-4cf3-9b7a-c72705a6b59f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:58.231636 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d8f992db-1606-4cf3-9b7a-c72705a6b59f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:58.246550 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d8f992db-1606-4cf3-9b7a-c72705a6b59f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:58.248273 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-d8f992db-1606-4cf3-9b7a-c72705a6b59f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:58.255921 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-d8f992db-1606-4cf3-9b7a-c72705a6b59f tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1737 microversion: 2.20 time: 0.194045 May 10 16:50:58.256943 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 371/717] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:58 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:58.360994 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1cecf01f-aa03-4e82-8462-1421facaba29 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:58.361565 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-1cecf01f-aa03-4e82-8462-1421facaba29 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:58.367570 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1cecf01f-aa03-4e82-8462-1421facaba29 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:58.368251 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1cecf01f-aa03-4e82-8462-1421facaba29 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:58.369177 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1cecf01f-aa03-4e82-8462-1421facaba29 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:58.369789 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1cecf01f-aa03-4e82-8462-1421facaba29 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:58.432990 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-c4a4289e-8edc-4a2a-bdb7-c2b3436478dc req-4f5d1f7c-962f-4177-8af4-4bd1fd20384f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c4579c-80bf-472e-947e-5c462a9815b9", "name": "network-vif-plugged", "status": "completed", "tag": "40f77e8c-82c4-483a-ba7f-bde1720036a7"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:50:58.441402 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-c4a4289e-8edc-4a2a-bdb7-c2b3436478dc req-4f5d1f7c-962f-4177-8af4-4bd1fd20384f service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:58.441846 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-c4a4289e-8edc-4a2a-bdb7-c2b3436478dc req-4f5d1f7c-962f-4177-8af4-4bd1fd20384f service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:58.453582 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-c4a4289e-8edc-4a2a-bdb7-c2b3436478dc req-4f5d1f7c-962f-4177-8af4-4bd1fd20384f service nova] Creating event network-vif-plugged:40f77e8c-82c4-483a-ba7f-bde1720036a7 for instance c0c4579c-80bf-472e-947e-5c462a9815b9 on hv-cinder-84130 May 10 16:50:58.461819 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-c4a4289e-8edc-4a2a-bdb7-c2b3436478dc req-4f5d1f7c-962f-4177-8af4-4bd1fd20384f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031752 May 10 16:50:58.464464 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 372/718] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:50:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:50:58.550840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-1cecf01f-aa03-4e82-8462-1421facaba29 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:58.561329 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-1cecf01f-aa03-4e82-8462-1421facaba29 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1576 microversion: 2.1 time: 0.203463 May 10 16:50:58.561919 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 347/719] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:58 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:58.973904 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f1a4728f-cd28-422c-b5f2-7d91275b0508 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:58.974535 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f1a4728f-cd28-422c-b5f2-7d91275b0508 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:58.980906 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f1a4728f-cd28-422c-b5f2-7d91275b0508 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:58.981359 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f1a4728f-cd28-422c-b5f2-7d91275b0508 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:58.982265 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f1a4728f-cd28-422c-b5f2-7d91275b0508 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:58.982705 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f1a4728f-cd28-422c-b5f2-7d91275b0508 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:59.045205 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-f266ba7b-7ef2-485c-a4da-59022c6ec550 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:59.045926 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-f266ba7b-7ef2-485c-a4da-59022c6ec550 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: c0c4579c-80bf-472e-947e-5c462a9815b9] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:59.058594 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f266ba7b-7ef2-485c-a4da-59022c6ec550 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:59.059166 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f266ba7b-7ef2-485c-a4da-59022c6ec550 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:59.060031 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f266ba7b-7ef2-485c-a4da-59022c6ec550 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:59.060537 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-f266ba7b-7ef2-485c-a4da-59022c6ec550 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:59.227204 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f1a4728f-cd28-422c-b5f2-7d91275b0508 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:59.236035 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f1a4728f-cd28-422c-b5f2-7d91275b0508 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1363 microversion: 2.1 time: 0.268425 May 10 16:50:59.247038 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 373/720] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:58 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:50:59.260056 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-f266ba7b-7ef2-485c-a4da-59022c6ec550 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:59.267994 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-f266ba7b-7ef2-485c-a4da-59022c6ec550 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9" status: 200 len: 1266 microversion: 2.1 time: 0.226646 May 10 16:50:59.274414 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-f6d8622c-c060-4335-b3b9-57bbcb443a1a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:59.275055 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-f6d8622c-c060-4335-b3b9-57bbcb443a1a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:59.278319 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 348/721] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:59 2022] GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:50:59.281739 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f6d8622c-c060-4335-b3b9-57bbcb443a1a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:59.282190 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f6d8622c-c060-4335-b3b9-57bbcb443a1a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:59.283004 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f6d8622c-c060-4335-b3b9-57bbcb443a1a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:59.283441 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-f6d8622c-c060-4335-b3b9-57bbcb443a1a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:59.423743 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f6d8622c-c060-4335-b3b9-57bbcb443a1a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:59.433551 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f6d8622c-c060-4335-b3b9-57bbcb443a1a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:59.435132 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-f6d8622c-c060-4335-b3b9-57bbcb443a1a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:59.436341 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-f6d8622c-c060-4335-b3b9-57bbcb443a1a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1737 microversion: 2.20 time: 0.165832 May 10 16:50:59.436951 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 374/722] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:50:59 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:50:59.577781 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-741a6f29-419f-464c-a090-b12668022621 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:50:59.578509 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-741a6f29-419f-464c-a090-b12668022621 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:50:59.585322 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-741a6f29-419f-464c-a090-b12668022621 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:59.585704 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-741a6f29-419f-464c-a090-b12668022621 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:59.586678 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-741a6f29-419f-464c-a090-b12668022621 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:50:59.587333 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-741a6f29-419f-464c-a090-b12668022621 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:50:59.770505 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-741a6f29-419f-464c-a090-b12668022621 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:50:59.779259 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-741a6f29-419f-464c-a090-b12668022621 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1576 microversion: 2.1 time: 0.205385 May 10 16:50:59.799788 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 349/723] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:50:59 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1576 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:00.256861 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-305980ec-4844-404c-ac20-def7f86d5cd6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:00.258099 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-305980ec-4844-404c-ac20-def7f86d5cd6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:00.272747 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-305980ec-4844-404c-ac20-def7f86d5cd6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:00.273391 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-305980ec-4844-404c-ac20-def7f86d5cd6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:00.274452 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-305980ec-4844-404c-ac20-def7f86d5cd6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:00.275248 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-305980ec-4844-404c-ac20-def7f86d5cd6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:00.285679 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b859bab7-202c-4920-bf39-5ed01d0fe682 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:00.286289 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-b859bab7-202c-4920-bf39-5ed01d0fe682 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: c0c4579c-80bf-472e-947e-5c462a9815b9] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:00.293931 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b859bab7-202c-4920-bf39-5ed01d0fe682 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:00.294378 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b859bab7-202c-4920-bf39-5ed01d0fe682 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:00.295371 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b859bab7-202c-4920-bf39-5ed01d0fe682 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:00.295806 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b859bab7-202c-4920-bf39-5ed01d0fe682 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:00.516494 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b859bab7-202c-4920-bf39-5ed01d0fe682 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:00.524790 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b859bab7-202c-4920-bf39-5ed01d0fe682 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9" status: 200 len: 1453 microversion: 2.1 time: 0.242958 May 10 16:51:00.525567 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 350/724] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:51:00 2022] GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9 => generated 1453 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:00.530518 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1e9d0c58-d557-4dd3-80c1-ae80c41cb7e3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:00.531519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-1e9d0c58-d557-4dd3-80c1-ae80c41cb7e3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:00.533494 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-305980ec-4844-404c-ac20-def7f86d5cd6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:00.538533 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1e9d0c58-d557-4dd3-80c1-ae80c41cb7e3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:00.539004 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1e9d0c58-d557-4dd3-80c1-ae80c41cb7e3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:00.539799 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1e9d0c58-d557-4dd3-80c1-ae80c41cb7e3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:00.540237 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1e9d0c58-d557-4dd3-80c1-ae80c41cb7e3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:00.544082 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-305980ec-4844-404c-ac20-def7f86d5cd6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1363 microversion: 2.1 time: 0.292090 May 10 16:51:00.546651 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 375/725] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:51:00 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:00.552309 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-f8043c54-cd9b-4c01-bdc2-742e7b514084 req-a4b8e878-b1d9-4ab6-84ec-1d6b04653676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f4723b-a74f-41ff-a8d8-eef312c22daf", "name": "network-vif-plugged", "status": "completed", "tag": "187771e7-4855-42c3-831b-feddd5408cb4"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:00.566289 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-f8043c54-cd9b-4c01-bdc2-742e7b514084 req-a4b8e878-b1d9-4ab6-84ec-1d6b04653676 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:00.567241 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-f8043c54-cd9b-4c01-bdc2-742e7b514084 req-a4b8e878-b1d9-4ab6-84ec-1d6b04653676 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:00.580214 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-f8043c54-cd9b-4c01-bdc2-742e7b514084 req-a4b8e878-b1d9-4ab6-84ec-1d6b04653676 service nova] Creating event network-vif-plugged:187771e7-4855-42c3-831b-feddd5408cb4 for instance f1f4723b-a74f-41ff-a8d8-eef312c22daf on hv-cinder-84130 May 10 16:51:00.586854 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-f8043c54-cd9b-4c01-bdc2-742e7b514084 req-a4b8e878-b1d9-4ab6-84ec-1d6b04653676 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038694 May 10 16:51:00.587504 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 376/726] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:51:00.593067 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-599897a8-8d4c-477c-8290-daa98b46b472 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:00.593765 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-599897a8-8d4c-477c-8290-daa98b46b472 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] [instance: c0c4579c-80bf-472e-947e-5c462a9815b9] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:00.600705 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-599897a8-8d4c-477c-8290-daa98b46b472 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:00.601161 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-599897a8-8d4c-477c-8290-daa98b46b472 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:00.601942 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-599897a8-8d4c-477c-8290-daa98b46b472 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:00.602383 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-599897a8-8d4c-477c-8290-daa98b46b472 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:00.759417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-1e9d0c58-d557-4dd3-80c1-ae80c41cb7e3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:00.768840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-1e9d0c58-d557-4dd3-80c1-ae80c41cb7e3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:00.771258 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-1e9d0c58-d557-4dd3-80c1-ae80c41cb7e3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:00.774133 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-1e9d0c58-d557-4dd3-80c1-ae80c41cb7e3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1737 microversion: 2.20 time: 0.247532 May 10 16:51:00.787690 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-599897a8-8d4c-477c-8290-daa98b46b472 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc2420288964c389f6529d9ede09bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84465c37c1474aa68266191586ba2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:00.789249 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 351/727] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:00 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1737 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:00.795099 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-599897a8-8d4c-477c-8290-daa98b46b472 tempest-TestVolumeBootPattern-471976404 tempest-TestVolumeBootPattern-471976404-project] 10.222.0.57 "GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9" status: 200 len: 1453 microversion: 2.1 time: 0.206332 May 10 16:51:00.795676 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 377/728] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:51:00 2022] GET /compute/v2.1/servers/c0c4579c-80bf-472e-947e-5c462a9815b9 => generated 1453 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:00.815093 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-1670dc1c-e101-424a-ac42-f3669b2961ef tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:00.815710 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-1670dc1c-e101-424a-ac42-f3669b2961ef tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:00.822370 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1670dc1c-e101-424a-ac42-f3669b2961ef tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:00.822814 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1670dc1c-e101-424a-ac42-f3669b2961ef tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:00.823617 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1670dc1c-e101-424a-ac42-f3669b2961ef tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:00.824050 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-1670dc1c-e101-424a-ac42-f3669b2961ef tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:01.098512 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-1670dc1c-e101-424a-ac42-f3669b2961ef tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:01.111361 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-1670dc1c-e101-424a-ac42-f3669b2961ef tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1576 microversion: 2.1 time: 0.301234 May 10 16:51:01.124199 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 352/729] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:51:00 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1576 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:01.580308 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8e03f80d-c3b2-4f4a-b5e0-f2632df9fe85 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:01.581563 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8e03f80d-c3b2-4f4a-b5e0-f2632df9fe85 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:01.588687 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8e03f80d-c3b2-4f4a-b5e0-f2632df9fe85 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:01.589288 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8e03f80d-c3b2-4f4a-b5e0-f2632df9fe85 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:01.590069 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8e03f80d-c3b2-4f4a-b5e0-f2632df9fe85 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:01.590507 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8e03f80d-c3b2-4f4a-b5e0-f2632df9fe85 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:01.795199 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-23ab366d-0bad-4e17-a988-577ff9938c0c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:01.796268 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-23ab366d-0bad-4e17-a988-577ff9938c0c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:01.806442 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-23ab366d-0bad-4e17-a988-577ff9938c0c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:01.807175 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-23ab366d-0bad-4e17-a988-577ff9938c0c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:01.808059 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-23ab366d-0bad-4e17-a988-577ff9938c0c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:01.808725 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-23ab366d-0bad-4e17-a988-577ff9938c0c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:01.865410 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8e03f80d-c3b2-4f4a-b5e0-f2632df9fe85 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:01.878098 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8e03f80d-c3b2-4f4a-b5e0-f2632df9fe85 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1363 microversion: 2.1 time: 0.296820 May 10 16:51:01.882216 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 378/730] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:51:01 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:02.046552 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-23ab366d-0bad-4e17-a988-577ff9938c0c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:02.063510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-23ab366d-0bad-4e17-a988-577ff9938c0c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:02.066525 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-23ab366d-0bad-4e17-a988-577ff9938c0c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:02.068793 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-23ab366d-0bad-4e17-a988-577ff9938c0c tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1737 microversion: 2.20 time: 0.277915 May 10 16:51:02.080232 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 353/731] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:01 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1737 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:51:02.136986 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3da713f7-1ddb-45d0-8fcd-8736faab47c7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:02.137701 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3da713f7-1ddb-45d0-8fcd-8736faab47c7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:02.148236 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3da713f7-1ddb-45d0-8fcd-8736faab47c7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:02.151422 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3da713f7-1ddb-45d0-8fcd-8736faab47c7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:02.152486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3da713f7-1ddb-45d0-8fcd-8736faab47c7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:02.152930 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3da713f7-1ddb-45d0-8fcd-8736faab47c7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:02.383366 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-3da713f7-1ddb-45d0-8fcd-8736faab47c7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:02.391821 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3da713f7-1ddb-45d0-8fcd-8736faab47c7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1576 microversion: 2.1 time: 0.265689 May 10 16:51:02.395476 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 379/732] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:51:02 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1576 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:02.898676 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-7d57ab7c-f8f2-4cdb-a2b3-85cb35ce701d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:02.899503 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-7d57ab7c-f8f2-4cdb-a2b3-85cb35ce701d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:02.915528 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7d57ab7c-f8f2-4cdb-a2b3-85cb35ce701d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:02.918013 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7d57ab7c-f8f2-4cdb-a2b3-85cb35ce701d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:02.918781 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7d57ab7c-f8f2-4cdb-a2b3-85cb35ce701d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:02.919280 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7d57ab7c-f8f2-4cdb-a2b3-85cb35ce701d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:03.089627 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-57ad528b-c3d4-4887-983e-50f7247a7370 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:03.091112 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-57ad528b-c3d4-4887-983e-50f7247a7370 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:03.102172 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-57ad528b-c3d4-4887-983e-50f7247a7370 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:03.102909 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-57ad528b-c3d4-4887-983e-50f7247a7370 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:03.103937 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-57ad528b-c3d4-4887-983e-50f7247a7370 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:03.104969 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-57ad528b-c3d4-4887-983e-50f7247a7370 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:03.289126 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7d57ab7c-f8f2-4cdb-a2b3-85cb35ce701d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:03.296359 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-7d57ab7c-f8f2-4cdb-a2b3-85cb35ce701d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1363 microversion: 2.1 time: 0.402585 May 10 16:51:03.296940 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 354/733] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:51:02 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1363 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:03.402149 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-57ad528b-c3d4-4887-983e-50f7247a7370 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:03.410506 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-ca47947f-4b87-43d7-ba15-2839a48c61e7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:03.410724 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-57ad528b-c3d4-4887-983e-50f7247a7370 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:03.411282 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-ca47947f-4b87-43d7-ba15-2839a48c61e7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:03.412532 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-57ad528b-c3d4-4887-983e-50f7247a7370 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:03.413742 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-57ad528b-c3d4-4887-983e-50f7247a7370 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1737 microversion: 2.20 time: 0.330552 May 10 16:51:03.414470 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 380/734] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:03 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1737 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:03.417363 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ca47947f-4b87-43d7-ba15-2839a48c61e7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:03.417894 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ca47947f-4b87-43d7-ba15-2839a48c61e7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:03.418914 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ca47947f-4b87-43d7-ba15-2839a48c61e7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:03.419608 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ca47947f-4b87-43d7-ba15-2839a48c61e7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:03.558509 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-c9e98631-7a01-48bc-a21e-f2ba0b208f35 req-e6218f69-b3f0-4706-8b82-dd927ece1098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c4579c-80bf-472e-947e-5c462a9815b9", "tag": "40f77e8c-82c4-483a-ba7f-bde1720036a7"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:03.571351 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-c9e98631-7a01-48bc-a21e-f2ba0b208f35 req-e6218f69-b3f0-4706-8b82-dd927ece1098 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:03.572159 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-c9e98631-7a01-48bc-a21e-f2ba0b208f35 req-e6218f69-b3f0-4706-8b82-dd927ece1098 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:03.586620 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-c9e98631-7a01-48bc-a21e-f2ba0b208f35 req-e6218f69-b3f0-4706-8b82-dd927ece1098 service nova] Creating event network-changed:40f77e8c-82c4-483a-ba7f-bde1720036a7 for instance c0c4579c-80bf-472e-947e-5c462a9815b9 on hv-cinder-84130 May 10 16:51:03.592559 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-c9e98631-7a01-48bc-a21e-f2ba0b208f35 req-e6218f69-b3f0-4706-8b82-dd927ece1098 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040631 May 10 16:51:03.593799 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 381/735] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:51:03.598388 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-ca47947f-4b87-43d7-ba15-2839a48c61e7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:03.606131 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-ca47947f-4b87-43d7-ba15-2839a48c61e7 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1576 microversion: 2.1 time: 0.200350 May 10 16:51:03.616525 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 355/736] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:51:03 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:04.314446 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2d8b0b78-a61b-4619-b2cf-d2044abc6399 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:04.315268 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2d8b0b78-a61b-4619-b2cf-d2044abc6399 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:04.336262 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2d8b0b78-a61b-4619-b2cf-d2044abc6399 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:04.337128 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2d8b0b78-a61b-4619-b2cf-d2044abc6399 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:04.338180 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2d8b0b78-a61b-4619-b2cf-d2044abc6399 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:04.342380 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2d8b0b78-a61b-4619-b2cf-d2044abc6399 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:04.436640 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-6889ebb2-9bbf-4361-aa47-d19ef3f32c92 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:04.437874 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-6889ebb2-9bbf-4361-aa47-d19ef3f32c92 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:04.446634 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6889ebb2-9bbf-4361-aa47-d19ef3f32c92 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:04.447107 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6889ebb2-9bbf-4361-aa47-d19ef3f32c92 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:04.447867 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6889ebb2-9bbf-4361-aa47-d19ef3f32c92 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:04.448463 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-6889ebb2-9bbf-4361-aa47-d19ef3f32c92 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:04.648300 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2d8b0b78-a61b-4619-b2cf-d2044abc6399 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:04.660051 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2d8b0b78-a61b-4619-b2cf-d2044abc6399 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1549 microversion: 2.1 time: 0.349272 May 10 16:51:04.661832 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 382/737] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:51:04 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1549 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:04.667655 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ba11f100-d1d2-466d-994b-321f45bc239c tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:04.669191 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ba11f100-d1d2-466d-994b-321f45bc239c tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:04.678753 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ba11f100-d1d2-466d-994b-321f45bc239c tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:04.679480 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ba11f100-d1d2-466d-994b-321f45bc239c tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:04.680436 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ba11f100-d1d2-466d-994b-321f45bc239c tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:04.681237 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ba11f100-d1d2-466d-994b-321f45bc239c tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:04.746688 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6889ebb2-9bbf-4361-aa47-d19ef3f32c92 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:04.759240 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6889ebb2-9bbf-4361-aa47-d19ef3f32c92 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:04.762396 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-6889ebb2-9bbf-4361-aa47-d19ef3f32c92 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:04.763792 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-6889ebb2-9bbf-4361-aa47-d19ef3f32c92 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1719 microversion: 2.20 time: 0.331205 May 10 16:51:04.776034 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 356/738] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:04 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1719 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:51:04.781786 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-c2582245-8120-4697-afc1-80ae856c7ed6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:04.782575 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-c2582245-8120-4697-afc1-80ae856c7ed6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:04.794123 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c2582245-8120-4697-afc1-80ae856c7ed6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:04.794580 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c2582245-8120-4697-afc1-80ae856c7ed6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:04.795440 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c2582245-8120-4697-afc1-80ae856c7ed6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:04.795876 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c2582245-8120-4697-afc1-80ae856c7ed6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:04.890514 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-ba11f100-d1d2-466d-994b-321f45bc239c tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:04.897845 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ba11f100-d1d2-466d-994b-321f45bc239c tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1576 microversion: 2.1 time: 0.234879 May 10 16:51:04.898415 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 383/739] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:51:04 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:04.902315 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-c2582245-8120-4697-afc1-80ae856c7ed6 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124714 May 10 16:51:04.903242 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 357/740] 10.222.0.57 () {58 vars in 1274 bytes} [Tue May 10 16:51:04 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:51:05.715666 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-7febb262-ff64-4a9e-a25c-71242bf3e225 req-364314d5-f36b-4876-8249-0e9bdc6bd5de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b14b06-9428-41e6-ae67-68b253218e24", "name": "network-vif-plugged", "status": "completed", "tag": "fdeeb8a2-0f74-40ea-acb1-f138b641a2ce"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:05.723774 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-7febb262-ff64-4a9e-a25c-71242bf3e225 req-364314d5-f36b-4876-8249-0e9bdc6bd5de service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:05.724221 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-7febb262-ff64-4a9e-a25c-71242bf3e225 req-364314d5-f36b-4876-8249-0e9bdc6bd5de service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:05.738034 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-7febb262-ff64-4a9e-a25c-71242bf3e225 req-364314d5-f36b-4876-8249-0e9bdc6bd5de service nova] Creating event network-vif-plugged:fdeeb8a2-0f74-40ea-acb1-f138b641a2ce for instance 25b14b06-9428-41e6-ae67-68b253218e24 on hv-cinder-84130 May 10 16:51:05.743366 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-7febb262-ff64-4a9e-a25c-71242bf3e225 req-364314d5-f36b-4876-8249-0e9bdc6bd5de service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031131 May 10 16:51:05.744207 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 384/741] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:51:05.784581 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-76b87927-4135-42a9-8ffc-cef553e6d262 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:05.785314 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-76b87927-4135-42a9-8ffc-cef553e6d262 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:05.791533 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-76b87927-4135-42a9-8ffc-cef553e6d262 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:05.792076 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-76b87927-4135-42a9-8ffc-cef553e6d262 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:05.792917 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-76b87927-4135-42a9-8ffc-cef553e6d262 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:05.793423 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-76b87927-4135-42a9-8ffc-cef553e6d262 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:05.897263 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-e852f70d-2322-4275-a760-54ba3a38177b req-caea3f81-66b6-43c7-85c5-fea494688550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1f4723b-a74f-41ff-a8d8-eef312c22daf", "tag": "187771e7-4855-42c3-831b-feddd5408cb4"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:05.905990 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-e852f70d-2322-4275-a760-54ba3a38177b req-caea3f81-66b6-43c7-85c5-fea494688550 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:05.906350 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-e852f70d-2322-4275-a760-54ba3a38177b req-caea3f81-66b6-43c7-85c5-fea494688550 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:05.919366 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-e852f70d-2322-4275-a760-54ba3a38177b req-caea3f81-66b6-43c7-85c5-fea494688550 service nova] Creating event network-changed:187771e7-4855-42c3-831b-feddd5408cb4 for instance f1f4723b-a74f-41ff-a8d8-eef312c22daf on hv-cinder-84130 May 10 16:51:05.924991 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-e852f70d-2322-4275-a760-54ba3a38177b req-caea3f81-66b6-43c7-85c5-fea494688550 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032568 May 10 16:51:05.925731 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 385/742] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:51:05.930998 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-109cb4f4-7d82-4a88-a818-72b851e87521 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:05.932007 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-109cb4f4-7d82-4a88-a818-72b851e87521 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:05.938842 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-109cb4f4-7d82-4a88-a818-72b851e87521 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:05.939444 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-109cb4f4-7d82-4a88-a818-72b851e87521 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:05.940312 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-109cb4f4-7d82-4a88-a818-72b851e87521 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:05.941470 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-109cb4f4-7d82-4a88-a818-72b851e87521 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:05.954344 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-76b87927-4135-42a9-8ffc-cef553e6d262 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:05.963227 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-76b87927-4135-42a9-8ffc-cef553e6d262 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:05.964755 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-76b87927-4135-42a9-8ffc-cef553e6d262 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:05.965900 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-76b87927-4135-42a9-8ffc-cef553e6d262 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1719 microversion: 2.20 time: 0.186920 May 10 16:51:05.976427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 358/743] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:05 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1719 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:06.075147 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-109cb4f4-7d82-4a88-a818-72b851e87521 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:06.082803 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-109cb4f4-7d82-4a88-a818-72b851e87521 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1576 microversion: 2.1 time: 0.155913 May 10 16:51:06.083410 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 386/744] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:51:05 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:51:06.983887 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-19d70957-57d2-4e69-b8c6-12713c3f09ac tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:06.984502 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-19d70957-57d2-4e69-b8c6-12713c3f09ac tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:06.991660 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-19d70957-57d2-4e69-b8c6-12713c3f09ac tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:06.992047 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-19d70957-57d2-4e69-b8c6-12713c3f09ac tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:06.992810 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-19d70957-57d2-4e69-b8c6-12713c3f09ac tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:06.993277 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-19d70957-57d2-4e69-b8c6-12713c3f09ac tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:07.099645 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-39ffc06d-3668-40fc-ac60-f71c5cafea23 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:07.100259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-39ffc06d-3668-40fc-ac60-f71c5cafea23 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:07.106457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-39ffc06d-3668-40fc-ac60-f71c5cafea23 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:07.106907 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-39ffc06d-3668-40fc-ac60-f71c5cafea23 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:07.107707 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-39ffc06d-3668-40fc-ac60-f71c5cafea23 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:07.108141 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-39ffc06d-3668-40fc-ac60-f71c5cafea23 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:07.119973 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-19d70957-57d2-4e69-b8c6-12713c3f09ac tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:07.127560 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-19d70957-57d2-4e69-b8c6-12713c3f09ac tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:07.129058 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-19d70957-57d2-4e69-b8c6-12713c3f09ac tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:07.130194 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-19d70957-57d2-4e69-b8c6-12713c3f09ac tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1722 microversion: 2.20 time: 0.150249 May 10 16:51:07.130749 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 359/745] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:06 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:07.147479 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-7e7f2d0d-58f2-485a-af7f-e297c7ccc43e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a326253-cf7b-4074-bf95-48ac5a95aa42"}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:07.148612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-7e7f2d0d-58f2-485a-af7f-e297c7ccc43e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:07.155292 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7e7f2d0d-58f2-485a-af7f-e297c7ccc43e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:07.155743 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7e7f2d0d-58f2-485a-af7f-e297c7ccc43e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:07.156525 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7e7f2d0d-58f2-485a-af7f-e297c7ccc43e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:07.156954 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7e7f2d0d-58f2-485a-af7f-e297c7ccc43e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:07.278649 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-39ffc06d-3668-40fc-ac60-f71c5cafea23 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:07.286810 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-39ffc06d-3668-40fc-ac60-f71c5cafea23 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1576 microversion: 2.1 time: 0.191510 May 10 16:51:07.287371 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 387/746] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:51:07 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1576 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:07.411711 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-7e7f2d0d-58f2-485a-af7f-e297c7ccc43e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "POST /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.268089 May 10 16:51:07.412305 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 360/747] 10.222.0.57 () {62 vars in 1363 bytes} [Tue May 10 16:51:07 2022] POST /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca/os-volume_attachments => generated 188 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 16:51:07.521505 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ef0d8a54-dd39-40af-8246-313f3a843959 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:07.522009 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ef0d8a54-dd39-40af-8246-313f3a843959 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:07.527855 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ef0d8a54-dd39-40af-8246-313f3a843959 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:07.528313 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ef0d8a54-dd39-40af-8246-313f3a843959 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:07.529088 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ef0d8a54-dd39-40af-8246-313f3a843959 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:07.529530 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ef0d8a54-dd39-40af-8246-313f3a843959 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:07.788429 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ef0d8a54-dd39-40af-8246-313f3a843959 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "DELETE /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca/os-volume_attachments/6a326253-cf7b-4074-bf95-48ac5a95aa42" status: 202 len: 0 microversion: 2.20 time: 0.271243 May 10 16:51:07.789103 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 388/748] 10.222.0.57 () {60 vars in 1456 bytes} [Tue May 10 16:51:07 2022] DELETE /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca/os-volume_attachments/6a326253-cf7b-4074-bf95-48ac5a95aa42 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 16:51:07.804269 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-4fc958b3-9e98-4340-8649-f7382de54586 req-0bdfb9f2-fec2-4fc7-bf63-9916b2a0b2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97528e0b-5eec-4ed3-aa10-b4d56c9803ca", "name": "network-vif-unplugged", "status": "completed", "tag": "f3864dfb-e0b5-4e42-879e-b9da171ec437"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:07.818150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-4fc958b3-9e98-4340-8649-f7382de54586 req-0bdfb9f2-fec2-4fc7-bf63-9916b2a0b2d3 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:07.818807 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-4fc958b3-9e98-4340-8649-f7382de54586 req-0bdfb9f2-fec2-4fc7-bf63-9916b2a0b2d3 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:07.830940 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.compute.server_external_events [req-4fc958b3-9e98-4340-8649-f7382de54586 req-0bdfb9f2-fec2-4fc7-bf63-9916b2a0b2d3 service nova] Unable to find a host for instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca. Dropping event network-vif-unplugged {{(pid=128925) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 16:51:07.832452 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-4fc958b3-9e98-4340-8649-f7382de54586 req-0bdfb9f2-fec2-4fc7-bf63-9916b2a0b2d3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032112 May 10 16:51:07.832929 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 361/749] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 10 16:51:07.849410 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-ab65495f-695c-4f27-92d3-205bc7aff158 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:07.849987 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-ab65495f-695c-4f27-92d3-205bc7aff158 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:07.858396 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ab65495f-695c-4f27-92d3-205bc7aff158 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:07.858854 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ab65495f-695c-4f27-92d3-205bc7aff158 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:07.859667 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ab65495f-695c-4f27-92d3-205bc7aff158 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:07.860107 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-ab65495f-695c-4f27-92d3-205bc7aff158 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:07.965823 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-ab65495f-695c-4f27-92d3-205bc7aff158 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "POST /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca/action" status: 202 len: 0 microversion: 2.20 time: 0.121371 May 10 16:51:07.966705 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 389/750] 10.222.0.57 () {62 vars in 1318 bytes} [Tue May 10 16:51:07 2022] POST /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 10 16:51:07.974786 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-acaf0d12-2ad6-44be-a147-9d8e22f5f0b7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:07.975559 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-acaf0d12-2ad6-44be-a147-9d8e22f5f0b7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:07.981935 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-acaf0d12-2ad6-44be-a147-9d8e22f5f0b7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:07.982383 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-acaf0d12-2ad6-44be-a147-9d8e22f5f0b7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:07.983190 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-acaf0d12-2ad6-44be-a147-9d8e22f5f0b7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:07.983654 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-acaf0d12-2ad6-44be-a147-9d8e22f5f0b7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:08.304893 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-2eabdbac-3d30-4e67-ae47-f6dcc340c7b4 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:08.305579 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-2eabdbac-3d30-4e67-ae47-f6dcc340c7b4 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:08.315106 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2eabdbac-3d30-4e67-ae47-f6dcc340c7b4 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:08.315807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2eabdbac-3d30-4e67-ae47-f6dcc340c7b4 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:08.316726 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2eabdbac-3d30-4e67-ae47-f6dcc340c7b4 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:08.317360 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-2eabdbac-3d30-4e67-ae47-f6dcc340c7b4 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:08.460894 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-acaf0d12-2ad6-44be-a147-9d8e22f5f0b7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:08.468738 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-acaf0d12-2ad6-44be-a147-9d8e22f5f0b7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:08.470242 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-acaf0d12-2ad6-44be-a147-9d8e22f5f0b7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:08.471762 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-acaf0d12-2ad6-44be-a147-9d8e22f5f0b7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1670 microversion: 2.20 time: 0.500909 May 10 16:51:08.473370 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 362/751] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:07 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1670 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:51:08.526616 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-2eabdbac-3d30-4e67-ae47-f6dcc340c7b4 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:08.536046 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-2eabdbac-3d30-4e67-ae47-f6dcc340c7b4 tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1563 microversion: 2.1 time: 0.235181 May 10 16:51:08.536259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 390/752] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:51:08 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1563 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:51:09.492140 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-9a22e191-ae4e-41a4-b3c1-8126f515184e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:09.493447 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-9a22e191-ae4e-41a4-b3c1-8126f515184e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:09.500313 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9a22e191-ae4e-41a4-b3c1-8126f515184e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:09.501080 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9a22e191-ae4e-41a4-b3c1-8126f515184e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:09.502006 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9a22e191-ae4e-41a4-b3c1-8126f515184e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:09.502496 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9a22e191-ae4e-41a4-b3c1-8126f515184e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:09.698552 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-9a22e191-ae4e-41a4-b3c1-8126f515184e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:09.707231 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-9a22e191-ae4e-41a4-b3c1-8126f515184e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:09.708769 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-9a22e191-ae4e-41a4-b3c1-8126f515184e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:09.709959 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-9a22e191-ae4e-41a4-b3c1-8126f515184e tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1728 microversion: 2.20 time: 0.222663 May 10 16:51:09.710522 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 363/753] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:09 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:10.729838 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b2c0c589-cdd3-4bb2-b192-01b6d9d68587 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:10.731345 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b2c0c589-cdd3-4bb2-b192-01b6d9d68587 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:10.738801 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b2c0c589-cdd3-4bb2-b192-01b6d9d68587 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:10.739274 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b2c0c589-cdd3-4bb2-b192-01b6d9d68587 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:10.740109 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b2c0c589-cdd3-4bb2-b192-01b6d9d68587 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:10.740588 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b2c0c589-cdd3-4bb2-b192-01b6d9d68587 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:10.893876 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b2c0c589-cdd3-4bb2-b192-01b6d9d68587 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:10.902722 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b2c0c589-cdd3-4bb2-b192-01b6d9d68587 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:10.904264 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b2c0c589-cdd3-4bb2-b192-01b6d9d68587 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:10.905438 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b2c0c589-cdd3-4bb2-b192-01b6d9d68587 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1728 microversion: 2.20 time: 0.180764 May 10 16:51:10.906090 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 391/754] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:10 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:11.925168 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-7cd36ee6-cf1c-46a6-af18-beb176d676ff tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:11.926022 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-7cd36ee6-cf1c-46a6-af18-beb176d676ff tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:11.935693 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7cd36ee6-cf1c-46a6-af18-beb176d676ff tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:11.936244 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7cd36ee6-cf1c-46a6-af18-beb176d676ff tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:11.937132 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7cd36ee6-cf1c-46a6-af18-beb176d676ff tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:11.937778 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7cd36ee6-cf1c-46a6-af18-beb176d676ff tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:12.076271 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7cd36ee6-cf1c-46a6-af18-beb176d676ff tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:12.085372 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7cd36ee6-cf1c-46a6-af18-beb176d676ff tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:12.086874 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7cd36ee6-cf1c-46a6-af18-beb176d676ff tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:12.088073 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-7cd36ee6-cf1c-46a6-af18-beb176d676ff tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1728 microversion: 2.20 time: 0.167268 May 10 16:51:12.088893 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 364/755] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:11 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:13.106812 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-666e13ba-0516-40e2-9208-0c1a71cd490a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:13.107475 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-666e13ba-0516-40e2-9208-0c1a71cd490a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:13.114008 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-666e13ba-0516-40e2-9208-0c1a71cd490a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:13.114467 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-666e13ba-0516-40e2-9208-0c1a71cd490a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:13.115294 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-666e13ba-0516-40e2-9208-0c1a71cd490a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:13.115736 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-666e13ba-0516-40e2-9208-0c1a71cd490a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:13.251752 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-666e13ba-0516-40e2-9208-0c1a71cd490a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:13.260779 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-666e13ba-0516-40e2-9208-0c1a71cd490a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:13.262369 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-666e13ba-0516-40e2-9208-0c1a71cd490a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:13.263650 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-666e13ba-0516-40e2-9208-0c1a71cd490a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1728 microversion: 2.20 time: 0.160747 May 10 16:51:13.264660 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 392/756] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:13 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:14.281768 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-46e0e7fb-5e38-417c-b029-23891bfed0bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:14.282395 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-46e0e7fb-5e38-417c-b029-23891bfed0bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:14.289683 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-46e0e7fb-5e38-417c-b029-23891bfed0bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:14.290139 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-46e0e7fb-5e38-417c-b029-23891bfed0bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:14.290923 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-46e0e7fb-5e38-417c-b029-23891bfed0bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:14.291395 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-46e0e7fb-5e38-417c-b029-23891bfed0bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:14.440491 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-46e0e7fb-5e38-417c-b029-23891bfed0bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:14.457427 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-46e0e7fb-5e38-417c-b029-23891bfed0bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:14.458998 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-46e0e7fb-5e38-417c-b029-23891bfed0bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:14.460253 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-46e0e7fb-5e38-417c-b029-23891bfed0bb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1728 microversion: 2.20 time: 0.182423 May 10 16:51:14.461078 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 365/757] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:14 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:51:15.478391 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-a376473f-d626-429f-a704-dc3aa92dcaa4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:15.479218 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-a376473f-d626-429f-a704-dc3aa92dcaa4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:15.486023 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a376473f-d626-429f-a704-dc3aa92dcaa4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:15.486483 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a376473f-d626-429f-a704-dc3aa92dcaa4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:15.487376 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a376473f-d626-429f-a704-dc3aa92dcaa4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:15.488358 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-a376473f-d626-429f-a704-dc3aa92dcaa4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:15.633493 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a376473f-d626-429f-a704-dc3aa92dcaa4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:15.642337 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a376473f-d626-429f-a704-dc3aa92dcaa4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:15.643979 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-a376473f-d626-429f-a704-dc3aa92dcaa4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:15.645181 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-a376473f-d626-429f-a704-dc3aa92dcaa4 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1728 microversion: 2.20 time: 0.170848 May 10 16:51:15.645931 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 393/758] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:15 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:16.663758 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-59e38acb-11cf-44c2-ac32-5906bb9b28d0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:16.664410 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-59e38acb-11cf-44c2-ac32-5906bb9b28d0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:16.670817 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-59e38acb-11cf-44c2-ac32-5906bb9b28d0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:16.671364 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-59e38acb-11cf-44c2-ac32-5906bb9b28d0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:16.672175 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-59e38acb-11cf-44c2-ac32-5906bb9b28d0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:16.672612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-59e38acb-11cf-44c2-ac32-5906bb9b28d0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:16.814279 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-59e38acb-11cf-44c2-ac32-5906bb9b28d0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:16.825037 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-59e38acb-11cf-44c2-ac32-5906bb9b28d0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:16.826624 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-59e38acb-11cf-44c2-ac32-5906bb9b28d0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:16.827905 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-59e38acb-11cf-44c2-ac32-5906bb9b28d0 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1728 microversion: 2.20 time: 0.168047 May 10 16:51:16.828677 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 366/759] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:16 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:17.846068 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-b61041e7-db3d-49d3-9c48-fc54029fc0c9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:17.846746 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-b61041e7-db3d-49d3-9c48-fc54029fc0c9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:17.853337 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b61041e7-db3d-49d3-9c48-fc54029fc0c9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:17.853795 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b61041e7-db3d-49d3-9c48-fc54029fc0c9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:17.854583 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b61041e7-db3d-49d3-9c48-fc54029fc0c9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:17.855042 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-b61041e7-db3d-49d3-9c48-fc54029fc0c9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:17.998923 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b61041e7-db3d-49d3-9c48-fc54029fc0c9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:18.008075 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b61041e7-db3d-49d3-9c48-fc54029fc0c9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:18.009549 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-b61041e7-db3d-49d3-9c48-fc54029fc0c9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:18.010725 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-b61041e7-db3d-49d3-9c48-fc54029fc0c9 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1728 microversion: 2.20 time: 0.168741 May 10 16:51:18.011665 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 394/760] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:17 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:51:19.029438 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-2441e62c-8e57-4710-80b3-19d625501cd3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:19.030143 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-2441e62c-8e57-4710-80b3-19d625501cd3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:19.038049 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2441e62c-8e57-4710-80b3-19d625501cd3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:19.038665 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2441e62c-8e57-4710-80b3-19d625501cd3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:19.039794 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2441e62c-8e57-4710-80b3-19d625501cd3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:19.040325 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-2441e62c-8e57-4710-80b3-19d625501cd3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:19.181433 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-2441e62c-8e57-4710-80b3-19d625501cd3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:19.189184 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-2441e62c-8e57-4710-80b3-19d625501cd3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:19.191229 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-2441e62c-8e57-4710-80b3-19d625501cd3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:19.192367 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-2441e62c-8e57-4710-80b3-19d625501cd3 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1728 microversion: 2.20 time: 0.167090 May 10 16:51:19.192921 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 367/761] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:19 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:20.209531 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8a25a985-cfc4-4fe9-9c98-7be5fa161288 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:20.210133 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8a25a985-cfc4-4fe9-9c98-7be5fa161288 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:20.216839 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8a25a985-cfc4-4fe9-9c98-7be5fa161288 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:20.217276 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8a25a985-cfc4-4fe9-9c98-7be5fa161288 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:20.218036 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8a25a985-cfc4-4fe9-9c98-7be5fa161288 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:20.218466 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8a25a985-cfc4-4fe9-9c98-7be5fa161288 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:20.346097 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8a25a985-cfc4-4fe9-9c98-7be5fa161288 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:20.354769 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8a25a985-cfc4-4fe9-9c98-7be5fa161288 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:20.356307 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8a25a985-cfc4-4fe9-9c98-7be5fa161288 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:20.357458 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8a25a985-cfc4-4fe9-9c98-7be5fa161288 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1728 microversion: 2.20 time: 0.151830 May 10 16:51:20.358050 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 395/762] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:20 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:21.375568 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-5a0ec539-7106-41a5-9b45-fde0b34db04a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:21.376186 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-5a0ec539-7106-41a5-9b45-fde0b34db04a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:21.382416 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5a0ec539-7106-41a5-9b45-fde0b34db04a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:21.382860 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5a0ec539-7106-41a5-9b45-fde0b34db04a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:21.383652 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5a0ec539-7106-41a5-9b45-fde0b34db04a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:21.384096 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-5a0ec539-7106-41a5-9b45-fde0b34db04a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:21.507386 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-5a0ec539-7106-41a5-9b45-fde0b34db04a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:21.515140 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-5a0ec539-7106-41a5-9b45-fde0b34db04a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:21.516637 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-5a0ec539-7106-41a5-9b45-fde0b34db04a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:21.517810 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-5a0ec539-7106-41a5-9b45-fde0b34db04a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1728 microversion: 2.20 time: 0.146126 May 10 16:51:21.518412 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 368/763] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:21 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:22.535880 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8ad0332c-e171-4b03-9ef8-f491d77ced6b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:22.536431 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8ad0332c-e171-4b03-9ef8-f491d77ced6b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:22.542640 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8ad0332c-e171-4b03-9ef8-f491d77ced6b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:22.543128 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8ad0332c-e171-4b03-9ef8-f491d77ced6b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:22.543900 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8ad0332c-e171-4b03-9ef8-f491d77ced6b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:22.544333 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8ad0332c-e171-4b03-9ef8-f491d77ced6b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:22.666473 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8ad0332c-e171-4b03-9ef8-f491d77ced6b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:22.674043 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8ad0332c-e171-4b03-9ef8-f491d77ced6b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:22.676099 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8ad0332c-e171-4b03-9ef8-f491d77ced6b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:22.677521 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8ad0332c-e171-4b03-9ef8-f491d77ced6b tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1728 microversion: 2.20 time: 0.145548 May 10 16:51:22.678129 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 396/764] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:22 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 16:51:23.696384 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-a0217cd0-c5de-4ee7-9745-9eb1eb888e77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:23.697673 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-a0217cd0-c5de-4ee7-9745-9eb1eb888e77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:23.704111 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a0217cd0-c5de-4ee7-9745-9eb1eb888e77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:23.704562 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a0217cd0-c5de-4ee7-9745-9eb1eb888e77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:23.705345 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a0217cd0-c5de-4ee7-9745-9eb1eb888e77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:23.705780 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-a0217cd0-c5de-4ee7-9745-9eb1eb888e77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:23.839634 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-0d7be859-930f-4bcd-a880-53b239300b4c req-dde82b48-dedf-4127-9b2d-d4dc249dc03a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97528e0b-5eec-4ed3-aa10-b4d56c9803ca", "name": "network-vif-plugged", "status": "completed", "tag": "f3864dfb-e0b5-4e42-879e-b9da171ec437"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:23.841876 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-a0217cd0-c5de-4ee7-9745-9eb1eb888e77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:23.848765 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-0d7be859-930f-4bcd-a880-53b239300b4c req-dde82b48-dedf-4127-9b2d-d4dc249dc03a service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:23.849440 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-0d7be859-930f-4bcd-a880-53b239300b4c req-dde82b48-dedf-4127-9b2d-d4dc249dc03a service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:23.850358 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-a0217cd0-c5de-4ee7-9745-9eb1eb888e77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:23.852030 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-a0217cd0-c5de-4ee7-9745-9eb1eb888e77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:23.853193 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-a0217cd0-c5de-4ee7-9745-9eb1eb888e77 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1728 microversion: 2.20 time: 0.160810 May 10 16:51:23.854319 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 369/765] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:23 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:23.861763 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-0d7be859-930f-4bcd-a880-53b239300b4c req-dde82b48-dedf-4127-9b2d-d4dc249dc03a service nova] Creating event network-vif-plugged:f3864dfb-e0b5-4e42-879e-b9da171ec437 for instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca on hv-cinder-84130 May 10 16:51:23.867145 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-0d7be859-930f-4bcd-a880-53b239300b4c req-dde82b48-dedf-4127-9b2d-d4dc249dc03a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031371 May 10 16:51:23.867781 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 397/766] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 16:51:24.870918 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b837c8e0-34dc-4454-ad75-6ffd50af1d40 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:24.871626 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-b837c8e0-34dc-4454-ad75-6ffd50af1d40 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:24.878047 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b837c8e0-34dc-4454-ad75-6ffd50af1d40 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:24.878499 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b837c8e0-34dc-4454-ad75-6ffd50af1d40 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:24.879299 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b837c8e0-34dc-4454-ad75-6ffd50af1d40 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:24.879735 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b837c8e0-34dc-4454-ad75-6ffd50af1d40 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:25.006995 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b837c8e0-34dc-4454-ad75-6ffd50af1d40 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:25.019324 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b837c8e0-34dc-4454-ad75-6ffd50af1d40 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:25.020926 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-b837c8e0-34dc-4454-ad75-6ffd50af1d40 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:25.022141 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b837c8e0-34dc-4454-ad75-6ffd50af1d40 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1728 microversion: 2.20 time: 0.155083 May 10 16:51:25.022705 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 370/767] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:24 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:26.041965 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-0b9924c6-ad80-4653-8b02-291f534524c7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:26.042644 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-0b9924c6-ad80-4653-8b02-291f534524c7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:26.048869 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0b9924c6-ad80-4653-8b02-291f534524c7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:26.049322 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0b9924c6-ad80-4653-8b02-291f534524c7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:26.050679 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0b9924c6-ad80-4653-8b02-291f534524c7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:26.051107 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-0b9924c6-ad80-4653-8b02-291f534524c7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:26.184169 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0b9924c6-ad80-4653-8b02-291f534524c7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:26.195342 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0b9924c6-ad80-4653-8b02-291f534524c7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:26.196960 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-0b9924c6-ad80-4653-8b02-291f534524c7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:26.198083 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-0b9924c6-ad80-4653-8b02-291f534524c7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1728 microversion: 2.20 time: 0.160755 May 10 16:51:26.198856 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 398/768] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:26 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:27.215560 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-c59cdf14-f29a-42c6-809d-8597e4bfe9f5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:27.216164 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-c59cdf14-f29a-42c6-809d-8597e4bfe9f5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:27.223223 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c59cdf14-f29a-42c6-809d-8597e4bfe9f5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:27.223666 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c59cdf14-f29a-42c6-809d-8597e4bfe9f5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:27.224420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c59cdf14-f29a-42c6-809d-8597e4bfe9f5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:27.224851 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c59cdf14-f29a-42c6-809d-8597e4bfe9f5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:27.351082 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c59cdf14-f29a-42c6-809d-8597e4bfe9f5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:27.358764 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c59cdf14-f29a-42c6-809d-8597e4bfe9f5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:27.360307 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c59cdf14-f29a-42c6-809d-8597e4bfe9f5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:27.361466 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-c59cdf14-f29a-42c6-809d-8597e4bfe9f5 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1715 microversion: 2.20 time: 0.149796 May 10 16:51:27.362035 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 371/769] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:51:27 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:51:49.567835 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-74afd8b1-5739-4f7f-b149-72c34463e322 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:49.568452 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-74afd8b1-5739-4f7f-b149-72c34463e322 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:49.574284 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-74afd8b1-5739-4f7f-b149-72c34463e322 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:49.574738 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-74afd8b1-5739-4f7f-b149-72c34463e322 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:49.575548 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-74afd8b1-5739-4f7f-b149-72c34463e322 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:49.575989 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-74afd8b1-5739-4f7f-b149-72c34463e322 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:49.598941 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-74afd8b1-5739-4f7f-b149-72c34463e322 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf/ips" status: 200 len: 146 microversion: 2.1 time: 0.036305 May 10 16:51:49.599512 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 399/770] 10.222.0.57 () {58 vars in 1247 bytes} [Tue May 10 16:51:49 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:51:51.677471 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-44d67efa-370e-4f66-a9c3-1719652cbdcd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fa35901-fa23-416b-927d-73927af3cd52"}} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:51.678591 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-44d67efa-370e-4f66-a9c3-1719652cbdcd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:51.684899 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-44d67efa-370e-4f66-a9c3-1719652cbdcd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:51.685353 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-44d67efa-370e-4f66-a9c3-1719652cbdcd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:51.686113 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-44d67efa-370e-4f66-a9c3-1719652cbdcd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:51.686548 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-44d67efa-370e-4f66-a9c3-1719652cbdcd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:51.929962 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-44d67efa-370e-4f66-a9c3-1719652cbdcd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "POST /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256503 May 10 16:51:51.930641 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 372/771] 10.222.0.57 () {60 vars in 1322 bytes} [Tue May 10 16:51:51 2022] POST /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:51:59.394829 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-41fc985e-1e71-4955-8954-edeeeb23f19f tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:51:59.401482 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-41fc985e-1e71-4955-8954-edeeeb23f19f tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:59.401925 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-41fc985e-1e71-4955-8954-edeeeb23f19f tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:59.464576 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-41fc985e-1e71-4955-8954-edeeeb23f19f tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Going to try to stop instance {{(pid=128924) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 16:51:59.506947 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-41fc985e-1e71-4955-8954-edeeeb23f19f tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "POST /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf/action" status: 202 len: 0 microversion: 2.1 time: 0.116440 May 10 16:51:59.507801 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 400/772] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 16:51:59 2022] POST /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:51:59.517304 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-32c11104-f048-4d71-8b52-b8577049d8cd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:51:59.518580 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-32c11104-f048-4d71-8b52-b8577049d8cd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:51:59.525849 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-32c11104-f048-4d71-8b52-b8577049d8cd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:59.526340 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-32c11104-f048-4d71-8b52-b8577049d8cd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:59.527098 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-32c11104-f048-4d71-8b52-b8577049d8cd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:51:59.527532 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-32c11104-f048-4d71-8b52-b8577049d8cd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:51:59.658386 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-32c11104-f048-4d71-8b52-b8577049d8cd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:51:59.666190 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-32c11104-f048-4d71-8b52-b8577049d8cd tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1724 microversion: 2.1 time: 0.153839 May 10 16:51:59.666758 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 373/773] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:51:59 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:00.684377 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-62f511c9-56ec-42e7-9f56-963911668a5e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:00.685080 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-62f511c9-56ec-42e7-9f56-963911668a5e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:00.691856 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62f511c9-56ec-42e7-9f56-963911668a5e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:00.692304 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62f511c9-56ec-42e7-9f56-963911668a5e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:00.693090 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62f511c9-56ec-42e7-9f56-963911668a5e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:00.693524 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-62f511c9-56ec-42e7-9f56-963911668a5e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:00.822563 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-62f511c9-56ec-42e7-9f56-963911668a5e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:00.830774 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-62f511c9-56ec-42e7-9f56-963911668a5e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1724 microversion: 2.1 time: 0.150175 May 10 16:52:00.831378 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 401/774] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:52:00 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:01.848473 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-c5b7660d-8cf7-44d1-88d4-58ec7855260e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:01.849087 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-c5b7660d-8cf7-44d1-88d4-58ec7855260e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:01.855384 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c5b7660d-8cf7-44d1-88d4-58ec7855260e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:01.855833 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c5b7660d-8cf7-44d1-88d4-58ec7855260e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:01.856601 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c5b7660d-8cf7-44d1-88d4-58ec7855260e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:01.857037 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-c5b7660d-8cf7-44d1-88d4-58ec7855260e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:01.984445 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-c5b7660d-8cf7-44d1-88d4-58ec7855260e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:01.992824 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-c5b7660d-8cf7-44d1-88d4-58ec7855260e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1724 microversion: 2.1 time: 0.148670 May 10 16:52:01.993388 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 374/775] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:52:01 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:03.009517 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-355d82ce-efb7-4c46-9e04-d38abab2dfcc tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:03.010132 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-355d82ce-efb7-4c46-9e04-d38abab2dfcc tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:03.016448 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-355d82ce-efb7-4c46-9e04-d38abab2dfcc tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:03.016900 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-355d82ce-efb7-4c46-9e04-d38abab2dfcc tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:03.018174 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-355d82ce-efb7-4c46-9e04-d38abab2dfcc tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:03.018616 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-355d82ce-efb7-4c46-9e04-d38abab2dfcc tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:03.146160 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-355d82ce-efb7-4c46-9e04-d38abab2dfcc tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:03.153901 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-355d82ce-efb7-4c46-9e04-d38abab2dfcc tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1724 microversion: 2.1 time: 0.148237 May 10 16:52:03.154486 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 402/776] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:52:03 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:04.171069 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-01c7a19a-f4e9-45cd-bbf1-8f91f6925a6d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:04.171680 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-01c7a19a-f4e9-45cd-bbf1-8f91f6925a6d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:04.178787 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-01c7a19a-f4e9-45cd-bbf1-8f91f6925a6d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:04.179265 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-01c7a19a-f4e9-45cd-bbf1-8f91f6925a6d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:04.180019 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-01c7a19a-f4e9-45cd-bbf1-8f91f6925a6d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:04.180479 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-01c7a19a-f4e9-45cd-bbf1-8f91f6925a6d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:04.305611 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-01c7a19a-f4e9-45cd-bbf1-8f91f6925a6d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:04.313997 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-01c7a19a-f4e9-45cd-bbf1-8f91f6925a6d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1724 microversion: 2.1 time: 0.146757 May 10 16:52:04.314567 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 375/777] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:52:04 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:05.331056 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-52d165a8-8685-4d23-9bca-2e5ee02b1a7d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:05.331606 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-52d165a8-8685-4d23-9bca-2e5ee02b1a7d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:05.338013 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-52d165a8-8685-4d23-9bca-2e5ee02b1a7d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:05.338462 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-52d165a8-8685-4d23-9bca-2e5ee02b1a7d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:05.339271 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-52d165a8-8685-4d23-9bca-2e5ee02b1a7d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:05.339710 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-52d165a8-8685-4d23-9bca-2e5ee02b1a7d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:05.462593 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-52d165a8-8685-4d23-9bca-2e5ee02b1a7d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:05.470320 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-52d165a8-8685-4d23-9bca-2e5ee02b1a7d tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1724 microversion: 2.1 time: 0.143358 May 10 16:52:05.470886 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 403/778] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:52:05 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:05.609125 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-ce845d80-bdcb-430f-920f-07be804ded25 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:05.610105 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-ce845d80-bdcb-430f-920f-07be804ded25 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:05.617179 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ce845d80-bdcb-430f-920f-07be804ded25 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:05.617739 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ce845d80-bdcb-430f-920f-07be804ded25 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:05.618541 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ce845d80-bdcb-430f-920f-07be804ded25 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:05.618997 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-ce845d80-bdcb-430f-920f-07be804ded25 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:05.647007 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-ce845d80-bdcb-430f-920f-07be804ded25 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041730 May 10 16:52:05.647550 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 376/779] 10.222.0.57 () {60 vars in 1342 bytes} [Tue May 10 16:52:05 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:05.705248 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6c32e574-772f-4aae-a734-c65acb05e5ec tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:05.705752 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6c32e574-772f-4aae-a734-c65acb05e5ec tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:05.711790 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6c32e574-772f-4aae-a734-c65acb05e5ec tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:05.712251 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6c32e574-772f-4aae-a734-c65acb05e5ec tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:05.713022 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6c32e574-772f-4aae-a734-c65acb05e5ec tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:05.713465 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6c32e574-772f-4aae-a734-c65acb05e5ec tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:05.738673 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6c32e574-772f-4aae-a734-c65acb05e5ec tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Going to try to terminate instance {{(pid=128924) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:52:05.814550 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6c32e574-772f-4aae-a734-c65acb05e5ec tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "DELETE /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 204 len: 0 microversion: 2.20 time: 0.112674 May 10 16:52:05.815173 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 404/780] 10.222.0.57 () {60 vars in 1279 bytes} [Tue May 10 16:52:05 2022] DELETE /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 16:52:05.823503 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-e2582a4e-3aec-46e6-9d72-62d83aed072a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:05.824141 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-e2582a4e-3aec-46e6-9d72-62d83aed072a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:05.830210 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e2582a4e-3aec-46e6-9d72-62d83aed072a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:05.830660 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e2582a4e-3aec-46e6-9d72-62d83aed072a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:05.831461 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e2582a4e-3aec-46e6-9d72-62d83aed072a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:05.831899 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e2582a4e-3aec-46e6-9d72-62d83aed072a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:05.955891 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-e2582a4e-3aec-46e6-9d72-62d83aed072a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:05.963625 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-e2582a4e-3aec-46e6-9d72-62d83aed072a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:05.965129 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-e2582a4e-3aec-46e6-9d72-62d83aed072a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:05.966280 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-e2582a4e-3aec-46e6-9d72-62d83aed072a tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1721 microversion: 2.20 time: 0.146581 May 10 16:52:05.966837 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 377/781] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:52:05 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1721 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:52:06.487297 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7b99cd96-6461-4a8a-bed4-79b3a89feaa2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:06.487910 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7b99cd96-6461-4a8a-bed4-79b3a89feaa2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:06.494160 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7b99cd96-6461-4a8a-bed4-79b3a89feaa2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:06.494606 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7b99cd96-6461-4a8a-bed4-79b3a89feaa2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:06.495391 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7b99cd96-6461-4a8a-bed4-79b3a89feaa2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:06.495827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7b99cd96-6461-4a8a-bed4-79b3a89feaa2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:06.627340 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7b99cd96-6461-4a8a-bed4-79b3a89feaa2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:06.634949 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7b99cd96-6461-4a8a-bed4-79b3a89feaa2 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1724 microversion: 2.1 time: 0.152004 May 10 16:52:06.635535 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 405/782] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:52:06 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:06.985724 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-67fb435a-70e3-4af0-a952-e41572a8bee1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:06.988350 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-67fb435a-70e3-4af0-a952-e41572a8bee1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:06.993082 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-67fb435a-70e3-4af0-a952-e41572a8bee1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:06.993523 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-67fb435a-70e3-4af0-a952-e41572a8bee1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:06.994278 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-67fb435a-70e3-4af0-a952-e41572a8bee1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:06.994707 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-67fb435a-70e3-4af0-a952-e41572a8bee1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:07.125054 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-67fb435a-70e3-4af0-a952-e41572a8bee1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:07.132687 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-67fb435a-70e3-4af0-a952-e41572a8bee1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:07.134170 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-67fb435a-70e3-4af0-a952-e41572a8bee1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:07.135400 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-67fb435a-70e3-4af0-a952-e41572a8bee1 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1721 microversion: 2.20 time: 0.153560 May 10 16:52:07.135984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 378/783] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:52:06 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:52:07.652763 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-e4641f03-f4b2-46f3-b6de-b9c4404729b7 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:07.653231 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-e4641f03-f4b2-46f3-b6de-b9c4404729b7 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:07.660170 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e4641f03-f4b2-46f3-b6de-b9c4404729b7 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:07.660617 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e4641f03-f4b2-46f3-b6de-b9c4404729b7 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:07.661381 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e4641f03-f4b2-46f3-b6de-b9c4404729b7 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:07.661816 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-e4641f03-f4b2-46f3-b6de-b9c4404729b7 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:07.838811 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-e4641f03-f4b2-46f3-b6de-b9c4404729b7 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:07.847754 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-e4641f03-f4b2-46f3-b6de-b9c4404729b7 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1724 microversion: 2.1 time: 0.198482 May 10 16:52:07.848475 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 406/784] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:52:07 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:08.153748 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-61dc3371-c4b9-4f4f-b227-968f95382dcd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:08.154525 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-61dc3371-c4b9-4f4f-b227-968f95382dcd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:08.160737 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-61dc3371-c4b9-4f4f-b227-968f95382dcd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:08.161977 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-61dc3371-c4b9-4f4f-b227-968f95382dcd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:08.163693 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-61dc3371-c4b9-4f4f-b227-968f95382dcd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:08.164362 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-61dc3371-c4b9-4f4f-b227-968f95382dcd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:08.177864 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-56795d49-01ba-4394-87ed-b0d2a9f2eb93 req-fcb4be79-48cf-433b-ac3d-f0d4515fc9fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97528e0b-5eec-4ed3-aa10-b4d56c9803ca", "name": "network-vif-deleted", "tag": "f3864dfb-e0b5-4e42-879e-b9da171ec437"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:08.185845 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-56795d49-01ba-4394-87ed-b0d2a9f2eb93 req-fcb4be79-48cf-433b-ac3d-f0d4515fc9fe service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:08.186295 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-56795d49-01ba-4394-87ed-b0d2a9f2eb93 req-fcb4be79-48cf-433b-ac3d-f0d4515fc9fe service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:08.197807 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-56795d49-01ba-4394-87ed-b0d2a9f2eb93 req-fcb4be79-48cf-433b-ac3d-f0d4515fc9fe service nova] Creating event network-vif-deleted:f3864dfb-e0b5-4e42-879e-b9da171ec437 for instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca on hv-cinder-84130 May 10 16:52:08.202621 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-56795d49-01ba-4394-87ed-b0d2a9f2eb93 req-fcb4be79-48cf-433b-ac3d-f0d4515fc9fe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028584 May 10 16:52:08.203374 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 407/785] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:52:08.249861 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-61dc3371-c4b9-4f4f-b227-968f95382dcd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:08.261161 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-61dc3371-c4b9-4f4f-b227-968f95382dcd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:08.262676 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-61dc3371-c4b9-4f4f-b227-968f95382dcd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48a7478e69d740e89da1201c954cbfe0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dbc7e862c11480e96d2804301e9796b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:08.263871 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-61dc3371-c4b9-4f4f-b227-968f95382dcd tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 200 len: 1653 microversion: 2.20 time: 0.114154 May 10 16:52:08.265650 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 379/786] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:52:08 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 1653 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 16:52:08.866316 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-49bf89c1-8ead-47ae-a01b-791e711a9d18 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:08.867057 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-49bf89c1-8ead-47ae-a01b-791e711a9d18 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:08.873089 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-49bf89c1-8ead-47ae-a01b-791e711a9d18 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:08.873551 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-49bf89c1-8ead-47ae-a01b-791e711a9d18 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:08.874337 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-49bf89c1-8ead-47ae-a01b-791e711a9d18 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:08.874778 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-49bf89c1-8ead-47ae-a01b-791e711a9d18 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:09.006870 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-49bf89c1-8ead-47ae-a01b-791e711a9d18 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:09.014924 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-49bf89c1-8ead-47ae-a01b-791e711a9d18 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1724 microversion: 2.1 time: 0.152871 May 10 16:52:09.015518 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 408/787] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:52:08 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:09.283925 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-d31b0390-d990-49b7-8c1f-5d1017cbacb7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:09.284596 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-d31b0390-d990-49b7-8c1f-5d1017cbacb7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:09.291048 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d31b0390-d990-49b7-8c1f-5d1017cbacb7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:09.291503 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d31b0390-d990-49b7-8c1f-5d1017cbacb7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:09.292273 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d31b0390-d990-49b7-8c1f-5d1017cbacb7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:09.292714 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-d31b0390-d990-49b7-8c1f-5d1017cbacb7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:09.305937 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.wsgi [None req-d31b0390-d990-49b7-8c1f-5d1017cbacb7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] HTTP exception thrown: Instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca could not be found. May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-d31b0390-d990-49b7-8c1f-5d1017cbacb7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Request method failure captured: May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca HTTP/1.1 May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 0 May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepaTDXqoJ4_ovIq35g2wdTCUSL_t9BgLVKLOc-1Lbv62T44jzWug_MLB2FVqcAGVusNHua-5h04eios-Ysa-gL1xJbMcieEMRc8nhYiW0nB9bcQkZGYOFFwSoKpfOq0ijmqIrKytckzmyK99XNIBUooNenWeDIC4NgH3wUfvhfOgbhM May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Openstack-Nova-Api-Version: 2.20 May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: 3dbc7e862c11480e96d2804301e9796b May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2006008443 May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:52:09.307612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:52:09.309600 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:52:09.309600 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2006008443 May 10 16:52:09.309600 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: 3dbc7e862c11480e96d2804301e9796b May 10 16:52:09.309600 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2006008443 May 10 16:52:09.309600 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-AttachVolumeShelveTestJSON-2006008443-project May 10 16:52:09.309600 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:52:09.309600 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:52:09.309600 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: 48a7478e69d740e89da1201c954cbfe0 May 10 16:52:09.309600 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2006008443-project May 10 16:52:09.309600 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: > May 10 16:52:09.309600 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca could not be found. May 10 16:52:09.309600 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'id': '97528e0b-5eec-4ed3-aa10-b4d56c9803ca'} May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca could not be found. May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:52:09.310534 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:52:09.312420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:52:09.312420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:52:09.312420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:52:09.312420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:52:09.312420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:52:09.312420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:52:09.312420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:52:09.312420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca could not be found. May 10 16:52:09.312420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:09.312420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:09.312420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:09.312420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:09.312420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:09.312420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:09.312420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:52:09.312420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:52:09.312420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca could not be found. May 10 16:52:09.312420 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:09.314567 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-d31b0390-d990-49b7-8c1f-5d1017cbacb7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Returning 404 to user: Instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca could not be found. {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:52:09.314567 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-d31b0390-d990-49b7-8c1f-5d1017cbacb7 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 404 len: 111 microversion: 2.20 time: 0.029700 May 10 16:52:09.314567 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 380/788] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:52:09 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 16:52:09.318458 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-c2f12978-e94f-4902-9da3-d24f011e6ca6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '.version_select at 0x7fdf19cb0a60>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:09.334977 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-c2f12978-e94f-4902-9da3-d24f011e6ca6 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-61845892" status: 204 len: 0 microversion: 2.20 time: 0.020352 May 10 16:52:09.335577 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 409/789] 10.222.0.57 () {60 vars in 1255 bytes} [Tue May 10 16:52:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-61845892 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 10 16:52:10.032528 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-142d78f0-634f-437a-9bf2-684a81b802b9 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:10.033245 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-142d78f0-634f-437a-9bf2-684a81b802b9 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:10.039136 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-142d78f0-634f-437a-9bf2-684a81b802b9 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:10.039664 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-142d78f0-634f-437a-9bf2-684a81b802b9 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:10.040442 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-142d78f0-634f-437a-9bf2-684a81b802b9 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:10.040888 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-142d78f0-634f-437a-9bf2-684a81b802b9 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:10.174402 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-142d78f0-634f-437a-9bf2-684a81b802b9 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:10.182283 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-142d78f0-634f-437a-9bf2-684a81b802b9 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1724 microversion: 2.1 time: 0.153805 May 10 16:52:10.182840 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 381/790] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:52:10 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:11.140107 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3229fa6d-f0d9-427c-9cc9-56a666c30d65 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:11.140602 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-3229fa6d-f0d9-427c-9cc9-56a666c30d65 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:11.146879 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3229fa6d-f0d9-427c-9cc9-56a666c30d65 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:11.147350 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3229fa6d-f0d9-427c-9cc9-56a666c30d65 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:11.148110 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3229fa6d-f0d9-427c-9cc9-56a666c30d65 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:11.148543 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-3229fa6d-f0d9-427c-9cc9-56a666c30d65 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:11.161604 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.wsgi [None req-3229fa6d-f0d9-427c-9cc9-56a666c30d65 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] HTTP exception thrown: Instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca could not be found. May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3229fa6d-f0d9-427c-9cc9-56a666c30d65 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Request method failure captured: May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: request: DELETE /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca HTTP/1.1 May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept: application/json May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Accept-Encoding: identity May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Connection: close May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Length: 0 May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Content-Type: application/json May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Host: 10.222.0.57 May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Openstack-System-Scope: None May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: User-Agent: python-urllib3/1.26.9 May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Auth-Token: gAAAAABiepaTDXqoJ4_ovIq35g2wdTCUSL_t9BgLVKLOc-1Lbv62T44jzWug_MLB2FVqcAGVusNHua-5h04eios-Ysa-gL1xJbMcieEMRc8nhYiW0nB9bcQkZGYOFFwSoKpfOq0ijmqIrKytckzmyK99XNIBUooNenWeDIC4NgH3wUfvhfOgbhM May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Id: None May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Domain-Name: None May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Identity-Status: Confirmed May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Is-Admin-Project: True May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Openstack-Nova-Api-Version: 2.20 May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Id: default May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Domain-Name: Default May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Id: 3dbc7e862c11480e96d2804301e9796b May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2006008443 May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Role: reader,member May 10 16:52:11.163259 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Roles: reader,member May 10 16:52:11.164899 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:52:11.164899 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2006008443 May 10 16:52:11.164899 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Id: 3dbc7e862c11480e96d2804301e9796b May 10 16:52:11.164899 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2006008443 May 10 16:52:11.164899 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User: tempest-AttachVolumeShelveTestJSON-2006008443-project May 10 16:52:11.164899 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Id: default May 10 16:52:11.164899 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Domain-Name: Default May 10 16:52:11.164899 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Id: 48a7478e69d740e89da1201c954cbfe0 May 10 16:52:11.164899 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2006008443-project May 10 16:52:11.164899 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: method: > May 10 16:52:11.164899 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: exception: Instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca could not be found. May 10 16:52:11.164899 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: action_args: {'id': '97528e0b-5eec-4ed3-aa10-b4d56c9803ca'} May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca could not be found. May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:52:11.165827 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca could not be found. May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca could not be found. May 10 16:52:11.167183 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: ERROR nova.api.openstack.wsgi May 10 16:52:11.169381 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-3229fa6d-f0d9-427c-9cc9-56a666c30d65 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Returning 404 to user: Instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca could not be found. {{(pid=128924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:52:11.169897 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-3229fa6d-f0d9-427c-9cc9-56a666c30d65 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "DELETE /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 404 len: 111 microversion: 2.20 time: 0.033434 May 10 16:52:11.170488 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 410/791] 10.222.0.57 () {60 vars in 1279 bytes} [Tue May 10 16:52:11 2022] DELETE /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 16:52:11.179360 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-9f285831-2ae8-45a5-9b73-af87fe191f08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:11.179965 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-9f285831-2ae8-45a5-9b73-af87fe191f08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 97528e0b-5eec-4ed3-aa10-b4d56c9803ca] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:11.186068 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9f285831-2ae8-45a5-9b73-af87fe191f08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:11.186510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9f285831-2ae8-45a5-9b73-af87fe191f08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:11.187333 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9f285831-2ae8-45a5-9b73-af87fe191f08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:11.187758 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-9f285831-2ae8-45a5-9b73-af87fe191f08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:11.200087 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-8585ece6-a752-4b95-a594-e3476140a791 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:11.200964 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-8585ece6-a752-4b95-a594-e3476140a791 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:11.201112 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.wsgi [None req-9f285831-2ae8-45a5-9b73-af87fe191f08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] HTTP exception thrown: Instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca could not be found. May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-9f285831-2ae8-45a5-9b73-af87fe191f08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Request method failure captured: May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca HTTP/1.1 May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 0 May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepaTDXqoJ4_ovIq35g2wdTCUSL_t9BgLVKLOc-1Lbv62T44jzWug_MLB2FVqcAGVusNHua-5h04eios-Ysa-gL1xJbMcieEMRc8nhYiW0nB9bcQkZGYOFFwSoKpfOq0ijmqIrKytckzmyK99XNIBUooNenWeDIC4NgH3wUfvhfOgbhM May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Openstack-Nova-Api-Version: 2.20 May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: 3dbc7e862c11480e96d2804301e9796b May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2006008443 May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:52:11.202510 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:52:11.204482 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:52:11.204482 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2006008443 May 10 16:52:11.204482 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: 3dbc7e862c11480e96d2804301e9796b May 10 16:52:11.204482 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2006008443 May 10 16:52:11.204482 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-AttachVolumeShelveTestJSON-2006008443-project May 10 16:52:11.204482 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:52:11.204482 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:52:11.204482 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: 48a7478e69d740e89da1201c954cbfe0 May 10 16:52:11.204482 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2006008443-project May 10 16:52:11.204482 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: > May 10 16:52:11.204482 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca could not be found. May 10 16:52:11.204482 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'id': '97528e0b-5eec-4ed3-aa10-b4d56c9803ca'} May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca could not be found. May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:52:11.205417 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:52:11.206842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:52:11.206842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:52:11.206842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:52:11.206842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:52:11.206842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:52:11.206842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:52:11.206842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:52:11.206842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca could not be found. May 10 16:52:11.206842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:11.206842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:11.206842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:11.206842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:11.206842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:11.206842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:11.206842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:52:11.206842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:52:11.206842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca could not be found. May 10 16:52:11.206842 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:11.208118 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-9f285831-2ae8-45a5-9b73-af87fe191f08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Returning 404 to user: Instance 97528e0b-5eec-4ed3-aa10-b4d56c9803ca could not be found. {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:52:11.208118 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-9f285831-2ae8-45a5-9b73-af87fe191f08 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca" status: 404 len: 111 microversion: 2.20 time: 0.028665 May 10 16:52:11.208118 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 382/792] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:52:11 2022] GET /compute/v2.1/servers/97528e0b-5eec-4ed3-aa10-b4d56c9803ca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 16:52:11.208370 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8585ece6-a752-4b95-a594-e3476140a791 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:11.208370 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8585ece6-a752-4b95-a594-e3476140a791 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:11.209110 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8585ece6-a752-4b95-a594-e3476140a791 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:11.209430 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-8585ece6-a752-4b95-a594-e3476140a791 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:11.346831 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-8585ece6-a752-4b95-a594-e3476140a791 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:11.354682 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-8585ece6-a752-4b95-a594-e3476140a791 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1724 microversion: 2.1 time: 0.158539 May 10 16:52:11.355278 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 411/793] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:52:11 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:12.343096 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b40f320d-5a69-498c-b34d-1e58fdd0a6cb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:12.343583 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-b40f320d-5a69-498c-b34d-1e58fdd0a6cb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:12.350287 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b40f320d-5a69-498c-b34d-1e58fdd0a6cb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:12.350734 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b40f320d-5a69-498c-b34d-1e58fdd0a6cb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:12.351553 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b40f320d-5a69-498c-b34d-1e58fdd0a6cb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:12.351988 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-b40f320d-5a69-498c-b34d-1e58fdd0a6cb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:12.365595 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.wsgi [None req-b40f320d-5a69-498c-b34d-1e58fdd0a6cb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] HTTP exception thrown: Instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 could not be found. May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b40f320d-5a69-498c-b34d-1e58fdd0a6cb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Request method failure captured: May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: DELETE /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 HTTP/1.1 May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 0 May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepaTDXqoJ4_ovIq35g2wdTCUSL_t9BgLVKLOc-1Lbv62T44jzWug_MLB2FVqcAGVusNHua-5h04eios-Ysa-gL1xJbMcieEMRc8nhYiW0nB9bcQkZGYOFFwSoKpfOq0ijmqIrKytckzmyK99XNIBUooNenWeDIC4NgH3wUfvhfOgbhM May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Openstack-Nova-Api-Version: 2.20 May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: 3dbc7e862c11480e96d2804301e9796b May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2006008443 May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:52:12.367150 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:52:12.368757 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:52:12.368757 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2006008443 May 10 16:52:12.368757 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: 3dbc7e862c11480e96d2804301e9796b May 10 16:52:12.368757 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2006008443 May 10 16:52:12.368757 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-AttachVolumeShelveTestJSON-2006008443-project May 10 16:52:12.368757 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:52:12.368757 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:52:12.368757 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: 48a7478e69d740e89da1201c954cbfe0 May 10 16:52:12.368757 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2006008443-project May 10 16:52:12.368757 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: > May 10 16:52:12.368757 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 could not be found. May 10 16:52:12.368757 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'id': '82a49eb5-dff1-452f-9e73-a8a9b0c64649'} May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 could not be found. May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:52:12.369602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 could not be found. May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 could not be found. May 10 16:52:12.371055 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:12.372591 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-b40f320d-5a69-498c-b34d-1e58fdd0a6cb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Returning 404 to user: Instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 could not be found. {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:52:12.372591 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-b40f320d-5a69-498c-b34d-1e58fdd0a6cb tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "DELETE /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 404 len: 111 microversion: 2.20 time: 0.029272 May 10 16:52:12.372591 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 383/794] 10.222.0.57 () {60 vars in 1279 bytes} [Tue May 10 16:52:12 2022] DELETE /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 16:52:12.374457 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-6502b341-7599-4411-a247-c2b81c3ff5f8 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:12.375174 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-6502b341-7599-4411-a247-c2b81c3ff5f8 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:12.376310 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-4f2b35e0-d66b-4f14-8c68-b303e9e37964 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:12.376984 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-4f2b35e0-d66b-4f14-8c68-b303e9e37964 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] [instance: 82a49eb5-dff1-452f-9e73-a8a9b0c64649] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:12.381687 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6502b341-7599-4411-a247-c2b81c3ff5f8 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:12.382204 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6502b341-7599-4411-a247-c2b81c3ff5f8 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:12.382768 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4f2b35e0-d66b-4f14-8c68-b303e9e37964 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:12.383147 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6502b341-7599-4411-a247-c2b81c3ff5f8 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:12.383283 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4f2b35e0-d66b-4f14-8c68-b303e9e37964 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:12.383587 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-6502b341-7599-4411-a247-c2b81c3ff5f8 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:12.384007 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4f2b35e0-d66b-4f14-8c68-b303e9e37964 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:12.384443 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-4f2b35e0-d66b-4f14-8c68-b303e9e37964 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:12.397370 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.wsgi [None req-4f2b35e0-d66b-4f14-8c68-b303e9e37964 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] HTTP exception thrown: Instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 could not be found. May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-4f2b35e0-d66b-4f14-8c68-b303e9e37964 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Request method failure captured: May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: request: GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 HTTP/1.1 May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept: application/json May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Accept-Encoding: identity May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Connection: close May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Length: 0 May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Content-Type: application/json May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Host: 10.222.0.57 May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Openstack-System-Scope: None May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: User-Agent: python-urllib3/1.26.9 May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Auth-Token: gAAAAABiepaTDXqoJ4_ovIq35g2wdTCUSL_t9BgLVKLOc-1Lbv62T44jzWug_MLB2FVqcAGVusNHua-5h04eios-Ysa-gL1xJbMcieEMRc8nhYiW0nB9bcQkZGYOFFwSoKpfOq0ijmqIrKytckzmyK99XNIBUooNenWeDIC4NgH3wUfvhfOgbhM May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Id: None May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Domain-Name: None May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Identity-Status: Confirmed May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Is-Admin-Project: True May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Openstack-Nova-Api-Version: 2.20 May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Id: default May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Domain-Name: Default May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Id: 3dbc7e862c11480e96d2804301e9796b May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2006008443 May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Role: reader,member May 10 16:52:12.398873 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Roles: reader,member May 10 16:52:12.400513 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3dbc7e862c11480e96d2804301e9796b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] May 10 16:52:12.400513 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2006008443 May 10 16:52:12.400513 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Id: 3dbc7e862c11480e96d2804301e9796b May 10 16:52:12.400513 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2006008443 May 10 16:52:12.400513 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User: tempest-AttachVolumeShelveTestJSON-2006008443-project May 10 16:52:12.400513 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Id: default May 10 16:52:12.400513 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Domain-Name: Default May 10 16:52:12.400513 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Id: 48a7478e69d740e89da1201c954cbfe0 May 10 16:52:12.400513 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2006008443-project May 10 16:52:12.400513 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: method: > May 10 16:52:12.400513 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: exception: Instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 could not be found. May 10 16:52:12.400513 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: action_args: {'id': '82a49eb5-dff1-452f-9e73-a8a9b0c64649'} May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 could not be found. May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 16:52:12.401519 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 16:52:12.402934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 16:52:12.402934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 16:52:12.402934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 16:52:12.402934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 16:52:12.402934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 16:52:12.402934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 16:52:12.402934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 16:52:12.402934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 could not be found. May 10 16:52:12.402934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:12.402934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 16:52:12.402934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:12.402934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 16:52:12.402934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 16:52:12.402934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 16:52:12.402934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 16:52:12.402934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 16:52:12.402934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 could not be found. May 10 16:52:12.402934 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: ERROR nova.api.openstack.wsgi May 10 16:52:12.405146 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-4f2b35e0-d66b-4f14-8c68-b303e9e37964 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] Returning 404 to user: Instance 82a49eb5-dff1-452f-9e73-a8a9b0c64649 could not be found. {{(pid=128925) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 16:52:12.405146 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-4f2b35e0-d66b-4f14-8c68-b303e9e37964 tempest-AttachVolumeShelveTestJSON-2006008443 tempest-AttachVolumeShelveTestJSON-2006008443-project] 10.222.0.57 "GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649" status: 404 len: 111 microversion: 2.20 time: 0.027517 May 10 16:52:12.405146 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 384/795] 10.222.0.57 () {60 vars in 1276 bytes} [Tue May 10 16:52:12 2022] GET /compute/v2.1/servers/82a49eb5-dff1-452f-9e73-a8a9b0c64649 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 16:52:12.517728 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-6502b341-7599-4411-a247-c2b81c3ff5f8 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:12.525502 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-6502b341-7599-4411-a247-c2b81c3ff5f8 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1724 microversion: 2.1 time: 0.157801 May 10 16:52:12.526077 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 412/796] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:52:12 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:52:13.543172 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-7c6aa128-4624-4923-8777-9edee145c445 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:13.544603 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-7c6aa128-4624-4923-8777-9edee145c445 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:13.552879 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7c6aa128-4624-4923-8777-9edee145c445 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:13.553576 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7c6aa128-4624-4923-8777-9edee145c445 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:13.554372 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7c6aa128-4624-4923-8777-9edee145c445 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:13.554816 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-7c6aa128-4624-4923-8777-9edee145c445 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:13.683957 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-7c6aa128-4624-4923-8777-9edee145c445 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:13.692347 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-7c6aa128-4624-4923-8777-9edee145c445 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1724 microversion: 2.1 time: 0.153173 May 10 16:52:13.693004 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 385/797] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:52:13 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:14.710045 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-45e2289c-ac7b-4c0a-bfc5-8e409626cf1a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:14.710711 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-45e2289c-ac7b-4c0a-bfc5-8e409626cf1a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:14.717661 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-45e2289c-ac7b-4c0a-bfc5-8e409626cf1a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:14.718110 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-45e2289c-ac7b-4c0a-bfc5-8e409626cf1a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:14.718889 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-45e2289c-ac7b-4c0a-bfc5-8e409626cf1a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:14.719343 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-45e2289c-ac7b-4c0a-bfc5-8e409626cf1a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:14.918305 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-45e2289c-ac7b-4c0a-bfc5-8e409626cf1a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:14.926266 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-45e2289c-ac7b-4c0a-bfc5-8e409626cf1a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1724 microversion: 2.1 time: 0.220602 May 10 16:52:14.927096 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 413/798] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:52:14 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:15.943203 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-99816908-0354-4d47-b0c0-63f137f43e3b tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:15.943827 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-99816908-0354-4d47-b0c0-63f137f43e3b tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:15.950281 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-99816908-0354-4d47-b0c0-63f137f43e3b tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:15.950733 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-99816908-0354-4d47-b0c0-63f137f43e3b tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:15.951535 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-99816908-0354-4d47-b0c0-63f137f43e3b tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:15.951978 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-99816908-0354-4d47-b0c0-63f137f43e3b tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:16.128341 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-99816908-0354-4d47-b0c0-63f137f43e3b tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:16.136033 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-99816908-0354-4d47-b0c0-63f137f43e3b tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1701 microversion: 2.1 time: 0.196703 May 10 16:52:16.136599 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 386/799] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:52:15 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1701 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 16:52:16.154079 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4e7fef2f-f12b-4e26-971b-f900bb3b370a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:16.160736 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4e7fef2f-f12b-4e26-971b-f900bb3b370a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:16.161174 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4e7fef2f-f12b-4e26-971b-f900bb3b370a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:16.184093 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4e7fef2f-f12b-4e26-971b-f900bb3b370a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Going to try to start instance {{(pid=128924) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 16:52:16.228928 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4e7fef2f-f12b-4e26-971b-f900bb3b370a tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "POST /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf/action" status: 202 len: 0 microversion: 2.1 time: 0.079057 May 10 16:52:16.229559 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 414/800] 10.222.0.57 () {60 vars in 1277 bytes} [Tue May 10 16:52:16 2022] POST /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 16:52:16.237937 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-34e9c5bc-0c19-47fd-b823-6a1243e1b19e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:16.238546 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-34e9c5bc-0c19-47fd-b823-6a1243e1b19e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:16.245101 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-34e9c5bc-0c19-47fd-b823-6a1243e1b19e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:16.245656 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-34e9c5bc-0c19-47fd-b823-6a1243e1b19e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:16.246753 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-34e9c5bc-0c19-47fd-b823-6a1243e1b19e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:16.247231 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-34e9c5bc-0c19-47fd-b823-6a1243e1b19e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:16.455720 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.policy [None req-34e9c5bc-0c19-47fd-b823-6a1243e1b19e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128925) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:16.464419 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-34e9c5bc-0c19-47fd-b823-6a1243e1b19e tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1710 microversion: 2.1 time: 0.230605 May 10 16:52:16.465581 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 387/801] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:52:16 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1710 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:17.482452 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-7cfeaa17-fdfd-48ef-a467-ff3272b0c550 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:17.483194 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-7cfeaa17-fdfd-48ef-a467-ff3272b0c550 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] [instance: f1f4723b-a74f-41ff-a8d8-eef312c22daf] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:17.489772 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7cfeaa17-fdfd-48ef-a467-ff3272b0c550 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:17.490224 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7cfeaa17-fdfd-48ef-a467-ff3272b0c550 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:17.491205 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7cfeaa17-fdfd-48ef-a467-ff3272b0c550 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:17.491652 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-7cfeaa17-fdfd-48ef-a467-ff3272b0c550 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:17.636140 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-7cfeaa17-fdfd-48ef-a467-ff3272b0c550 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f037681adf2f4d5a8585e3a8820534ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c689db207d9b4ca7af21395734fc14d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:17.644569 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-7cfeaa17-fdfd-48ef-a467-ff3272b0c550 tempest-AttachVolumeTestJSON-1202849239 tempest-AttachVolumeTestJSON-1202849239-project] 10.222.0.57 "GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf" status: 200 len: 1714 microversion: 2.1 time: 0.166653 May 10 16:52:17.645460 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 415/802] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:52:17 2022] GET /compute/v2.1/servers/f1f4723b-a74f-41ff-a8d8-eef312c22daf => generated 1714 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:28.756469 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [None req-e65f3858-c4f2-405b-83d3-55351b41b74a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:28.756959 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-e65f3858-c4f2-405b-83d3-55351b41b74a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128925) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:28.761894 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [req-f064c39c-6411-43fd-94e2-25f2b469361b req-612e057e-14d4-4f4e-8a81-30de23349634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b14b06-9428-41e6-ae67-68b253218e24", "tag": "fdeeb8a2-0f74-40ea-acb1-f138b641a2ce"}]} {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:28.770875 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-f064c39c-6411-43fd-94e2-25f2b469361b req-612e057e-14d4-4f4e-8a81-30de23349634 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:28.771452 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [req-f064c39c-6411-43fd-94e2-25f2b469361b req-612e057e-14d4-4f4e-8a81-30de23349634 service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:28.773078 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e65f3858-c4f2-405b-83d3-55351b41b74a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:28.773606 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e65f3858-c4f2-405b-83d3-55351b41b74a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:28.774458 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e65f3858-c4f2-405b-83d3-55351b41b74a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:28.775066 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [None req-e65f3858-c4f2-405b-83d3-55351b41b74a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:28.782754 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.compute.server_external_events [req-f064c39c-6411-43fd-94e2-25f2b469361b req-612e057e-14d4-4f4e-8a81-30de23349634 service nova] Creating event network-changed:fdeeb8a2-0f74-40ea-acb1-f138b641a2ce for instance 25b14b06-9428-41e6-ae67-68b253218e24 on hv-cinder-84130 May 10 16:52:28.788351 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [req-f064c39c-6411-43fd-94e2-25f2b469361b req-612e057e-14d4-4f4e-8a81-30de23349634 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029983 May 10 16:52:28.789109 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 416/803] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:52:28.801789 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.compute.api [None req-e65f3858-c4f2-405b-83d3-55351b41b74a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Going to try to terminate instance {{(pid=128925) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 16:52:28.884561 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [None req-e65f3858-c4f2-405b-83d3-55351b41b74a tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "DELETE /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 204 len: 0 microversion: 2.1 time: 0.132458 May 10 16:52:28.885331 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 388/804] 10.222.0.57 () {58 vars in 1238 bytes} [Tue May 10 16:52:28 2022] DELETE /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 16:52:28.893804 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.api.openstack.wsgi [None req-4631e426-5aa4-455f-b8e8-7907d6c4f4ed tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Calling method '>' {{(pid=128924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 16:52:28.894518 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.compute.api [None req-4631e426-5aa4-455f-b8e8-7907d6c4f4ed tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] [instance: 25b14b06-9428-41e6-ae67-68b253218e24] Fetching instance by UUID {{(pid=128924) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 16:52:28.900547 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4631e426-5aa4-455f-b8e8-7907d6c4f4ed tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:28.900991 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4631e426-5aa4-455f-b8e8-7907d6c4f4ed tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:28.901753 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4631e426-5aa4-455f-b8e8-7907d6c4f4ed tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:28.902187 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG oslo_concurrency.lockutils [None req-4631e426-5aa4-455f-b8e8-7907d6c4f4ed tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:29.035622 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: DEBUG nova.policy [None req-4631e426-5aa4-455f-b8e8-7907d6c4f4ed tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97dcd026697f4ac099a2f518408b89ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5da35de420b4b908dde94da66c0ecd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128924) authorize /opt/stack/nova/nova/policy.py:199}} May 10 16:52:29.042953 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO nova.api.openstack.requestlog [None req-4631e426-5aa4-455f-b8e8-7907d6c4f4ed tempest-TestShelveInstance-2020108292 tempest-TestShelveInstance-2020108292-project] 10.222.0.57 "GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24" status: 200 len: 1569 microversion: 2.1 time: 0.153285 May 10 16:52:29.043545 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: [pid: 128924|app: 0|req: 417/805] 10.222.0.57 () {58 vars in 1235 bytes} [Tue May 10 16:52:28 2022] GET /compute/v2.1/servers/25b14b06-9428-41e6-ae67-68b253218e24 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 16:52:32.488474 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG nova.api.openstack.wsgi [req-cb58c71d-6961-4200-a71a-418b7a56f219 req-6ae2aa94-e2e1-4a87-9a7f-64b257d942fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b14b06-9428-41e6-ae67-68b253218e24", "name": "network-vif-deleted", "tag": "fdeeb8a2-0f74-40ea-acb1-f138b641a2ce"}]} {{(pid=128925) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 16:52:32.497569 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-cb58c71d-6961-4200-a71a-418b7a56f219 req-6ae2aa94-e2e1-4a87-9a7f-64b257d942fb service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 16:52:32.498011 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: DEBUG oslo_concurrency.lockutils [req-cb58c71d-6961-4200-a71a-418b7a56f219 req-6ae2aa94-e2e1-4a87-9a7f-64b257d942fb service nova] Lock "4d8f7176-9260-4d0a-bdf3-ff932fd2323c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128925) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 16:52:32.509374 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.compute.server_external_events [req-cb58c71d-6961-4200-a71a-418b7a56f219 req-6ae2aa94-e2e1-4a87-9a7f-64b257d942fb service nova] Creating event network-vif-deleted:fdeeb8a2-0f74-40ea-acb1-f138b641a2ce for instance 25b14b06-9428-41e6-ae67-68b253218e24 on hv-cinder-84130 May 10 16:52:32.514602 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO nova.api.openstack.requestlog [req-cb58c71d-6961-4200-a71a-418b7a56f219 req-6ae2aa94-e2e1-4a87-9a7f-64b257d942fb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030115 May 10 16:52:32.515298 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: [pid: 128925|app: 0|req: 389/806] 10.222.0.57 () {64 vars in 1317 bytes} [Tue May 10 16:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 16:53:28.264970 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 16:53:28.265528 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Tue May 10 16:53:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 16:53:40.611170 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 16:53:40.611805 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Tue May 10 16:53:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 16:55:18.563644 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 16:55:18.564221 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Tue May 10 16:55:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 16:55:21.735547 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 16:55:21.736364 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Tue May 10 16:55:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 16:55:26.304797 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 16:55:26.305361 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Tue May 10 16:55:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 16:56:41.846565 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 16:56:41.847082 dv-cinder-841302-1-iscsi devstack@n-api.service[128924]: Tue May 10 16:56:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 16:56:48.273097 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 16:56:48.273612 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Tue May 10 16:56:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 16:57:00.619444 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 16:57:00.620118 dv-cinder-841302-1-iscsi devstack@n-api.service[128925]: Tue May 10 16:57:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!